Aug 17 16:09:17 devstack cinder-volume[83414]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 16:09:17 devstack cinder-volume[83414]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 16:09:17 devstack cinder-volume[83414]: we strongly recommend against using it for new projects. Aug 17 16:09:17 devstack cinder-volume[83414]: If you are already using Eventlet, we recommend migrating to a different Aug 17 16:09:17 devstack cinder-volume[83414]: framework. For more detail see Aug 17 16:09:17 devstack cinder-volume[83414]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 16:09:17 devstack cinder-volume[83414]: import eventlet # noqa Aug 17 16:09:21 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:09:21 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:09:21 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:09:22 devstack cinder-volume[83414]: INFO dbcounter [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Registered counter for database cinder Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG oslo_db.sqlalchemy.engines [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83414) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG dbcounter [-] [83414] Writer thread running {{(pid=83414) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:09:22 devstack cinder-volume[83414]: INFO cinder.rpc [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 16:09:22 devstack cinder-volume[83414]: INFO cinder.rpc [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG oslo_db.sqlalchemy.engines [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83414) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:09:22 devstack cinder-volume[83414]: INFO cinder.volume.manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Determined volume DB was empty at startup. Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG cinder.volume.manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83414) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 16:09:22 devstack cinder-volume[83414]: INFO cinder.volume.manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 17 16:09:22 devstack cinder-volume[83414]: WARNING stevedore.named [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 16:09:22 devstack cinder-volume[83414]: WARNING castellan.key_manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:09:22 devstack cinder-volume[83414]: WARNING cinder.keymgr.conf_key_mgr [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG cinder.volume.drivers.lvm [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83414) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 17 16:09:22 devstack cinder-volume[83414]: DEBUG oslo_concurrency.processutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83414) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_concurrency.processutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] CMD "cinder-rtstool verify" returned: 0 in 0.574s {{(pid=83414) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_db.sqlalchemy.engines [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83414) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:09:23 devstack cinder-volume[83414]: INFO cinder.rpc [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 17 16:09:23 devstack cinder-volume[83414]: INFO cinder.rpc [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 17 16:09:23 devstack cinder-volume[83414]: WARNING stevedore.named [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 16:09:23 devstack cinder-volume[83414]: WARNING castellan.key_manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:09:23 devstack cinder-volume[83414]: INFO cinder.volume.manager [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_db.sqlalchemy.engines [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83414) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:09:23 devstack cinder-volume[83414]: INFO oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Starting 1 workers Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Started child 83565 {{(pid=83414) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Full set of CONF: {{(pid=83414) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] ******************************************************************************** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Configuration options gathered from: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 16:09:23 devstack cinder-volume[83565]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] ================================================================================ {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] allow_availability_zone_fallback = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] allow_compression_on_image_upload = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] allowed_direct_url_schemes = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] api_rate_limit = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] auth_strategy = keystone {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] az_cache_duration = 3600 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_availability_zone = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_host = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_stats_polling_interval = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backup_api_class = cinder.backup.api.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backup_name_template = backup-%s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backup_use_same_host = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backup_use_temp_snapshot = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] chap_password = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] chap_username = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_internal_tenant_project_id = 7d2a2320382d453fb464f32a1515a581 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_internal_tenant_user_id = 4dc9b5c29b1746379fbc476d09d73820 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cloned_volume_same_az = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cluster = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] compression_format = gzip {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] compute_api_class = cinder.compute.nova.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] config_dir = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] config_source = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] control_exchange = openstack {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] debug = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] default_availability_zone = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] default_group_type = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] default_volume_type = lvmdriver-1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] disk_geometry = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_client_cert = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_client_cert_key = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: INFO cinder.volume.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_data_namespace = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_ssl_cert_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_ssl_cert_verify = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] driver_use_ssl = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] enable_force_upload = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] enable_new_services = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] enable_unsupported_driver = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] enabled_backends = ['lvmdriver-1'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] enforce_multipath_for_image_xfer = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] filter_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_api_insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_api_ssl_compression = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_ca_certificates_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_catalog_info = image:glance:publicURL {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_num_retries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance_request_timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] goodness_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] graceful_shutdown_timeout = 5 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] group_api_class = cinder.group.api.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] host = devstack {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_compress_on_upload = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_conversion_address_space_limit = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_conversion_cpu_limit = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_conversion_disable = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_upload_use_cinder_backend = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_upload_use_internal_tenant = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_volume_cache_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_volume_cache_max_count = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] image_volume_cache_max_size_gb = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] init_host_max_objects_retrieval = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] instance_format = [instance: %(uuid)s] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iscsi_target_flags = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iscsi_write_cache = on {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iser_helper = tgtadm {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iser_ip_address = 192.168.122.201 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iser_port = 3260 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_color = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_config_append = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_dir = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_options = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_rotate_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_rotate_interval_type = days {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] log_rotation_type = none {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] max_age = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] max_logfile_count = 30 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] max_logfile_size_mb = 200 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] max_over_subscription_ratio = 20.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] message_reap_interval = 86400 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] message_ttl = 2592000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] migration_create_volume_timeout_secs = 300 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] monkey_patch = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] monkey_patch_modules = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] my_ip = 192.168.122.201 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] no_snapshot_gb_quota = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] num_iser_scan_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] num_shell_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] num_volume_device_scan_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] nvmeof_conn_info_version = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] nvmet_ns_id = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] nvmet_port_id = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_max_limit = 1000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_ext_list = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_listen = 0.0.0.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_listen_port = 8776 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_use_ssl = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] osapi_volume_workers = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] per_volume_size_limit = -1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] periodic_fuzzy_delay = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] periodic_interval = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] project_id_regex = [0-9a-f\-]+ {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] public_endpoint = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] publish_errors = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_backup_gigabytes = 1000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_backups = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_gigabytes = 1000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_groups = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_snapshots = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] quota_volumes = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] rate_limit_burst = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] rate_limit_except_level = CRITICAL {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] rate_limit_interval = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] reinit_driver_count = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] replication_device = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] report_discard_supported = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] report_interval = 120 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] reservation_clean_interval = 86400 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] reservation_expire = 86400 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] reserved_image_namespaces = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] reserved_percentage = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] rpc_response_timeout = 120 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] run_external_periodic_tasks = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] scst_target_driver = iscsi {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] scst_target_iqn_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_down_time = 720 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] shell_completion = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] snapshot_name_template = snapshot-%s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] snapshot_same_host = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] split_loggers = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] state_path = /opt/stack/data/cinder {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] storage_availability_zone = nova {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] storage_protocol = iSCSI {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] syslog_log_facility = LOG_USER {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_helper = lioadm {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_ip_address = 192.168.122.201 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_port = 3260 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_protocol = iscsi {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] target_secondary_ip_addresses = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] trace_flags = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] transfer_api_class = cinder.transfer.api.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] transport_url = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] until_refresh = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_chap_auth = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_default_quota_class = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_journal = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_json = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_multipath_for_image_xfer = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_stderr = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] use_syslog = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] verify_glance_signatures = enabled {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_api_class = cinder.volume.api.API {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_backend_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_clear = zero {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_clear_ionice = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_clear_size = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_copy_bps_limit = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_dd_blocksize = 1M {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 17 16:09:23 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_name_template = volume-%s {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_service_inithost_offload = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volume_usage_audit_period = month {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] zoning_mode = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_concurrency.disable_process_locking = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.auth_section = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.auth_type = password {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.auth_version = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.cache = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.delay_auth_decision = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.http_connect_timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.include_service_catalog = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.interface = public {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_password = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcache_username = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.region_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.service_token_roles_required = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.service_type = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.token_cache_time = 300 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.backend = dogpile.cache.null {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.backend_argument = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.backend_expiration_time = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.config_prefix = cache.oslo {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.debug_cache_backend = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.enable_retry_client = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.enable_socket_keepalive = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.expiration_time = 600 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.hashclient_retry_attempts = 2 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_dead_retry = 300 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_pool_maxsize = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_sasl_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.password = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.proxies = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.redis_db = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.redis_sentinel_service_name = mymaster {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.redis_server = localhost:6379 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.retry_attempts = 2 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.retry_delay = 0.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.socket_keepalive_count = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.socket_keepalive_idle = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.socket_keepalive_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.socket_timeout = 1.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.tls_allowed_ciphers = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.tls_cafile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.tls_certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.tls_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.tls_keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cache.username = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] coordination.backend_url = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.asyncio_connection = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.asyncio_slave_connection = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.backend = sqlalchemy {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.connection = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.connection_debug = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.connection_parameters = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.connection_recycle_time = 3600 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.connection_trace = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.db_inc_retry_interval = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.db_max_retries = 20 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.db_max_retry_interval = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.db_retry_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.max_overflow = 50 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.max_pool_size = 5 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.max_retries = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.mysql_wsrep_sync_wait = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.pool_timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.retry_interval = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.slave_connection = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.sqlite_synchronous = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.synchronous_reader = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] database.use_db_reconnect = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.connection_string = messaging:// {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.es_doc_type = notification {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.es_scroll_size = 10000 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.es_scroll_time = 2m {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.filter_error_trace = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.hmac_keys = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.sentinel_service_name = mymaster {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.socket_timeout = 0.1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.trace_requests = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler.trace_sqlalchemy = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler_jaeger.process_tags = {} {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler_jaeger.service_name_prefix = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] profiler_otlp.service_name_prefix = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.enforce_new_defaults = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.policy_default_rule = default {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.policy_file = policy.yaml {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_policy.remote_timeout = 60.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.group = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.helper_command = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] privsep_osbrick.user = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.group = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.helper_command = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] cinder_sys_admin.user = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.auth_section = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.auth_type = password {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.cafile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.collect_timing = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.send_service_user_token = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.split_loggers = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] service_user.timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.auth_section = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.auth_type = password {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.collect_timing = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.region_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.split_loggers = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] glance.timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.backend_availability_zone = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.chap_password = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.chap_username = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.disk_geometry = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_client_cert = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_client_cert_key = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_data_namespace = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.driver_use_ssl = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.enable_unsupported_driver = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.extra_capabilities = {} {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.filter_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.goodness_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iscsi_target_flags = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iscsi_write_cache = on {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iser_helper = tgtadm {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iser_port = 3260 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.lvm_mirrors = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.lvm_share_target = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.lvm_type = auto {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.num_shell_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.nvmet_port_id = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.replication_device = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.report_discard_supported = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.reserved_percentage = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.scst_target_driver = iscsi {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.scst_target_iqn_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.storage_protocol = iSCSI {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_helper = tgtadm {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_port = 3260 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_protocol = iscsi {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.trace_flags = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.unique_fqdn_network = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.use_chap_auth = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_backend_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_clear = zero {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_clear_ionice = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_clear_size = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volume_group = cinder-volumes {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_reports.file_event_handler = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_reports.log_dir = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.backend_availability_zone = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.backend_host = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.chap_password = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.chap_username = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.chiscsi_conf = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.disk_geometry = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_client_cert = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_data_namespace = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.driver_use_ssl = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.extra_capabilities = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.filter_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.goodness_function = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iser_helper = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iser_ip_address = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iser_port = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.iser_target_prefix = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.lvm_conf_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.lvm_mirrors = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.lvm_share_target = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.lvm_type = auto {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.num_shell_tries = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.nvmet_port_id = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.replication_device = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.report_discard_supported = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.reserved_percentage = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.scst_target_driver = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.storage_protocol = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_helper = lioadm {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_ip_address = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_port = 3260 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_protocol = iscsi {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.trace_flags = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.use_chap_auth = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_clear = zero {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_clear_size = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] lvmdriver-1.volumes_dir = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.ssl_version = {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_notifications.driver = [] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_notifications.retry = -1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] oslo_messaging_notifications.transport_url = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] key_manager.fixed_key = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.barbican_api_version = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.barbican_endpoint = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.barbican_endpoint_type = public {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.barbican_region_name = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.cafile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.collect_timing = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.number_of_retries = 60 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.retry_delay = 1 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.send_service_user_token = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.split_loggers = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.verify_ssl = True {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican.verify_ssl_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.auth_section = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.auth_type = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.cafile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.certfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.collect_timing = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.insecure = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.keyfile = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.split_loggers = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] barbican_service_user.timeout = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.approle_role_id = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.approle_secret_id = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.auth_method = approle {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.auth_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.kv_mountpoint = secret {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.kv_path = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.kv_version = 2 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.namespace = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.root_token_id = **** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.ssl_ca_crt_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.timeout = 60.0 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.token_file = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.token_role = None {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.use_ssl = False {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:09:23 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] ******************************************************************************** {{(pid=83414) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 16:09:23 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.318s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:23 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:23 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:23 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:24 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.262s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:09:24 devstack cinder-volume[83565]: INFO cinder.brick.local_dev.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:24 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:24 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:24 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG cinder.brick.local_dev.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83565) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:24 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:24 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:24 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:24 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:24 devstack sudo[84059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:24 devstack sudo[84059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:25 devstack sudo[84059]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.341s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:25 devstack sudo[84175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 17 16:09:25 devstack sudo[84175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:25 devstack sudo[84175]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.267s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:25 devstack sudo[84178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:25 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:25 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:25 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:25 devstack sudo[84262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:25 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:26 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:26 devstack sudo[84265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:26 devstack sudo[84265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:26 devstack sudo[84265]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:26 devstack sudo[84326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:26 devstack sudo[84326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:26 devstack sudo[84326]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:26 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:26 devstack sudo[84358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:26 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:27 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:27 devstack cinder-volume[83565]: INFO cinder.volume.drivers.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:27 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:27 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:27 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:27 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:27 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:27 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:27 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:27 devstack sudo[84381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:27 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:28 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:28 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:28 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:28 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:28 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:28 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:28 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:28 devstack cinder-volume[83565]: INFO cinder.volume.driver [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Driver hasn't implemented _init_vendor_properties() Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG cinder.volume.driver [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83565) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_db.sqlalchemy.engines [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83565) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writer thread running {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG cinder.db.api [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Building query based on filter {{(pid=83565) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG cinder.image.image_utils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83565) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 16:09:28 devstack cinder-volume[83565]: INFO cinder.keymgr.migration [None req-dd163e0a-5080-4928-b8fa-b81f34adf1e3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:09:28 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:28 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:28 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:29 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:29 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:29 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:29 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:29 devstack sudo[84399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:29 devstack sudo[84399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:29 devstack sudo[84399]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:29 devstack sudo[84402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:29 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:29 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG cinder.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Notifying Schedulers of capabilities ... {{(pid=83565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:09:29 devstack cinder-volume[83565]: INFO cinder.volume.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Driver initialization completed successfully. Aug 17 16:09:29 devstack cinder-volume[83565]: INFO cinder.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Initiating service 2 cleanup Aug 17 16:09:29 devstack cinder-volume[83565]: INFO cinder.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Service 2 cleanup completed. Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG cinder.service [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Creating RPC server for service cinder-volume {{(pid=83565) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG cinder.service [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83565) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 16:09:29 devstack cinder-volume[83565]: INFO cinder.volume.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:09:29 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:30 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:09:30 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:30 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:30 devstack sudo[84410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:30 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:30 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:30 devstack sudo[84413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:09:30 devstack sudo[84413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:30 devstack sudo[84413]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:30 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:09:30 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:09:30 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:09:31 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Aug 17 16:09:31 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:09:31 devstack cinder-volume[83565]: INFO cinder.volume.manager [None req-e496624c-4e15-4f9b-a0c1-db8e8c742d6e None None] Driver post RPC initialization completed successfully. Aug 17 16:09:33 devstack cinder-volume[83414]: DEBUG dbcounter [-] [83414] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83414) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:09:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:SELECT=3 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:09:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:10:19 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager._thread_info {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:10:19 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread count: 6 {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:10:19 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread info: [<_MainThread(MainThread, started 130126113255552)>, , , , , ] {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:11:19 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:11:19 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:11:19 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:11:19 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:11:19 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:11:19 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:11:19 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:11:19 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:11:19 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:11:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:11:19 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:11:19 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:11:20 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Aug 17 16:11:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:11:20 devstack cinder-volume[83565]: DEBUG cinder.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Notifying Schedulers of capabilities ... {{(pid=83565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:11:20 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager._thread_info {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:11:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread count: 6 {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:11:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread info: [<_MainThread(MainThread, started 130126113255552)>, , , , , ] {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:11:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:SELECT=1 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:11:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:UPDATE=1 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:12:19 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:12:19 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:12:19 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:12:19 devstack sudo[91144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:12:19 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:12:19 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:12:19 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:12:19 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:12:19 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:12:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:12:20 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:12:20 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:12:20 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Aug 17 16:12:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:12:20 devstack cinder-volume[83565]: DEBUG cinder.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Notifying Schedulers of capabilities ... {{(pid=83565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:12:20 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager._thread_info {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:12:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread count: 6 {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:12:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread info: [<_MainThread(MainThread, started 130126113255552)>, , , , , ] {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:13:19 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:13:19 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:13:19 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:13:19 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:13:19 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:13:19 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:13:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:13:19 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:13:19 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:13:20 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Aug 17 16:13:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:13:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:13:20 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:13:20 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:13:20 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Aug 17 16:13:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:13:20 devstack cinder-volume[83565]: DEBUG cinder.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Notifying Schedulers of capabilities ... {{(pid=83565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:13:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:SELECT=1 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:13:41 devstack cinder-volume[83565]: DEBUG dbcounter [-] [83565] Writing DB stats cinder:UPDATE=1 {{(pid=83565) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG cinder.volume.drivers.lvm [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Updating volume stats {{(pid=83565) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:19 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 17 16:14:19 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:19 devstack cinder-volume[83414]: INFO oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Caught SIGTERM, stopping children Aug 17 16:14:19 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Acquiring lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:19 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Acquired lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:19 devstack cinder-volume[83414]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Releasing lock "singleton_lock" {{(pid=83414) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:19 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Stop services. {{(pid=83414) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 17 16:14:19 devstack cinder-volume[83414]: DEBUG oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Killing children. {{(pid=83414) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 17 16:14:19 devstack cinder-volume[83414]: INFO oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Waiting on 1 children to exit Aug 17 16:14:19 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:19 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:14:19 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:19 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:19 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:19 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 17 16:14:19 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:19 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:20 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 17 16:14:20 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:20 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.processutils [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=83565) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG cinder.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Notifying Schedulers of capabilities ... {{(pid=83565) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_service.periodic_task [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] Running periodic task VolumeManager._thread_info {{(pid=83565) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread count: 5 {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG cinder.volume.manager [None req-7c4a8e60-a6c3-417f-bcf5-97421a86e082 None None] thread info: [<_MainThread(MainThread, started 130126113255552)>, , , , ] {{(pid=83565) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Acquiring lock "singleton_lock" {{(pid=83565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Acquired lock "singleton_lock" {{(pid=83565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:20 devstack cinder-volume[83565]: DEBUG oslo_concurrency.lockutils [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Releasing lock "singleton_lock" {{(pid=83565) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:20 devstack cinder-volume[83565]: WARNING amqp [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 16:14:20 devstack cinder-volume[83565]: WARNING amqp [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 16:14:20 devstack cinder-volume[83414]: INFO oslo_service.backend._eventlet.service [None req-99db1581-c03d-4331-bf09-edd8c763981f None None] Child 83565 exited with status 0 Aug 17 16:14:20 devstack cinder-volume[93724]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 16:14:20 devstack cinder-volume[93724]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 16:14:20 devstack cinder-volume[93724]: we strongly recommend against using it for new projects. Aug 17 16:14:20 devstack cinder-volume[93724]: If you are already using Eventlet, we recommend migrating to a different Aug 17 16:14:20 devstack cinder-volume[93724]: framework. For more detail see Aug 17 16:14:20 devstack cinder-volume[93724]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 16:14:20 devstack cinder-volume[93724]: import eventlet # noqa Aug 17 16:14:23 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:23 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:23 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:23 devstack cinder-volume[93724]: INFO dbcounter [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Registered counter for database cinder Aug 17 16:14:23 devstack cinder-volume[93724]: DEBUG oslo_db.sqlalchemy.engines [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG dbcounter [-] [93724] Writer thread running {{(pid=93724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:14:24 devstack cinder-volume[93724]: INFO cinder.rpc [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 16:14:24 devstack cinder-volume[93724]: INFO cinder.rpc [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_db.sqlalchemy.engines [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:24 devstack cinder-volume[93724]: INFO cinder.volume.manager [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Determined volume DB was empty at startup. Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG cinder.volume.manager [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93724) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 16:14:24 devstack cinder-volume[93724]: INFO cinder.volume.manager [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 17 16:14:24 devstack cinder-volume[93724]: WARNING stevedore.named [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 16:14:24 devstack cinder-volume[93724]: WARNING castellan.key_manager [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:14:24 devstack cinder-volume[93724]: WARNING cinder.keymgr.conf_key_mgr [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:14:24 devstack cinder-volume[93724]: INFO cinder.volume.manager [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_db.sqlalchemy.engines [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93724) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:24 devstack cinder-volume[93724]: INFO oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Starting 1 workers Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Started child 93970 {{(pid=93724) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Full set of CONF: {{(pid=93724) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] ******************************************************************************** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Configuration options gathered from: {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] ================================================================================ {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] allow_availability_zone_fallback = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] allow_compression_on_image_upload = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] allowed_direct_url_schemes = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] api_rate_limit = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] auth_strategy = keystone {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_availability_zone = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93970]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_host = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_stats_polling_interval = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backup_api_class = cinder.backup.api.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backup_name_template = backup-%s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backup_use_same_host = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backup_use_temp_snapshot = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] chap_password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] chap_username = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_internal_tenant_project_id = 7d2a2320382d453fb464f32a1515a581 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_internal_tenant_user_id = 4dc9b5c29b1746379fbc476d09d73820 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cluster = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] compression_format = gzip {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] config_dir = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] config_source = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] control_exchange = openstack {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] debug = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] default_availability_zone = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] default_group_type = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] default_volume_type = QuobyteHD {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] disk_geometry = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_client_cert = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_client_cert_key = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_data_namespace = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_ssl_cert_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_ssl_cert_verify = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] driver_use_ssl = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] enable_new_services = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] enable_unsupported_driver = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] enabled_backends = ['QuobyteHD'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] enforce_multipath_for_image_xfer = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] filter_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_api_insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_api_ssl_compression = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_ca_certificates_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_num_retries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance_request_timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] goodness_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] graceful_shutdown_timeout = 5 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] group_api_class = cinder.group.api.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] host = devstack {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_compress_on_upload = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_conversion_address_space_limit = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_conversion_cpu_limit = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_conversion_disable = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_upload_use_cinder_backend = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_upload_use_internal_tenant = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_volume_cache_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_volume_cache_max_count = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] init_host_max_objects_retrieval = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] instance_format = [instance: %(uuid)s] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iscsi_target_flags = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iscsi_write_cache = on {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iser_helper = tgtadm {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iser_ip_address = 192.168.122.201 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iser_port = 3260 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_color = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_config_append = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_dir = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_options = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_rotate_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_rotate_interval_type = days {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] log_rotation_type = none {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] max_age = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] max_logfile_count = 30 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] max_logfile_size_mb = 200 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] max_over_subscription_ratio = 20.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] message_reap_interval = 86400 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] message_ttl = 2592000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] monkey_patch = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] monkey_patch_modules = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] my_ip = 192.168.122.201 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] no_snapshot_gb_quota = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] num_iser_scan_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] num_shell_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] num_volume_device_scan_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] nvmeof_conn_info_version = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] nvmet_ns_id = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] nvmet_port_id = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_max_limit = 1000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_ext_list = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_listen_port = 8776 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_use_ssl = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] osapi_volume_workers = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] per_volume_size_limit = -1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] periodic_fuzzy_delay = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] periodic_interval = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] public_endpoint = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] publish_errors = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_backup_gigabytes = 1000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_backups = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_gigabytes = 1000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_groups = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_snapshots = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] quota_volumes = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] rate_limit_burst = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] rate_limit_except_level = CRITICAL {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] rate_limit_interval = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] reinit_driver_count = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] replication_device = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] report_discard_supported = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] report_interval = 120 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] reservation_clean_interval = 86400 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] reservation_expire = 86400 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] reserved_image_namespaces = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] reserved_percentage = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] rpc_response_timeout = 120 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] run_external_periodic_tasks = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] scst_target_driver = iscsi {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] scst_target_iqn_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_down_time = 720 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] shell_completion = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] snapshot_name_template = snapshot-%s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] split_loggers = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] state_path = /opt/stack/data/cinder {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] storage_availability_zone = nova {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] storage_protocol = iSCSI {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] syslog_log_facility = LOG_USER {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_helper = lioadm {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_ip_address = 192.168.122.201 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_port = 3260 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_protocol = iscsi {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] target_secondary_ip_addresses = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] trace_flags = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] transport_url = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] until_refresh = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_chap_auth = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_default_quota_class = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_journal = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_json = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_multipath_for_image_xfer = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_stderr = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] use_syslog = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] verify_glance_signatures = enabled {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_api_class = cinder.volume.api.API {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93970]: INFO cinder.volume.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Starting volume driver QuobyteDriver (1.2) Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_backend_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_clear = zero {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_clear_ionice = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_clear_size = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_copy_bps_limit = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_dd_blocksize = 1M {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.remotefs [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93970) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_name_template = volume-%s {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_service_inithost_offload = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volume_usage_audit_period = month {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] zoning_mode = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.auth_section = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.auth_type = password {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.auth_version = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.cache = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.interface = public {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_password = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcache_username = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.region_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.service_type = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.backend = dogpile.cache.null {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.backend_argument = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.backend_expiration_time = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.config_prefix = cache.oslo {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.debug_cache_backend = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.enable_retry_client = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.enable_socket_keepalive = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.expiration_time = 600 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_dead_retry = 300 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_sasl_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.proxies = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.redis_db = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.redis_server = localhost:6379 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.retry_attempts = 2 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.retry_delay = 0.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.socket_keepalive_count = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.socket_keepalive_idle = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.socket_keepalive_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.socket_timeout = 1.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.tls_allowed_ciphers = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.tls_cafile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.tls_certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.tls_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.tls_keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cache.username = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] coordination.backend_url = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.asyncio_connection = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.asyncio_slave_connection = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.backend = sqlalchemy {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.connection = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.connection_debug = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.connection_parameters = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.connection_recycle_time = 3600 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.connection_trace = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.db_inc_retry_interval = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.db_max_retries = 20 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.db_max_retry_interval = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.db_retry_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.max_overflow = 50 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.max_pool_size = 5 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.max_retries = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.pool_timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.retry_interval = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.slave_connection = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.sqlite_synchronous = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.synchronous_reader = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] database.use_db_reconnect = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.connection_string = messaging:// {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.es_doc_type = notification {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.es_scroll_size = 10000 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.es_scroll_time = 2m {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.filter_error_trace = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.hmac_keys = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.sentinel_service_name = mymaster {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.socket_timeout = 0.1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.trace_requests = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler.trace_sqlalchemy = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler_jaeger.process_tags = {} {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] profiler_otlp.service_name_prefix = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.policy_default_rule = default {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.group = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.helper_command = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] privsep_osbrick.user = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.group = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.helper_command = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] cinder_sys_admin.user = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.auth_section = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.auth_type = password {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.cafile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.collect_timing = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.send_service_user_token = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.split_loggers = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] service_user.timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.auth_section = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.auth_type = password {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.collect_timing = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.region_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.split_loggers = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] glance.timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.backend_availability_zone = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.chap_password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.chap_username = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.disk_geometry = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_client_cert = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_data_namespace = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.driver_use_ssl = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.extra_capabilities = {} {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.filter_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.goodness_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iscsi_target_flags = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iser_port = 3260 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_host = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_login = admin {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_mount_options = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_private_key = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_share_path = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.quobyte_volume_url = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.replication_device = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.report_discard_supported = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_helper = tgtadm {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_port = 3260 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_protocol = iscsi {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.trace_flags = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93970) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 17 16:14:24 devstack cinder-volume[93970]: WARNING cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 17 16:14:24 devstack cinder-volume[93970]: WARNING cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.use_chap_auth = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_backend_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_clear = zero {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Running cmd (subprocess): mount.quobyte {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_reports.file_event_handler = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_reports.log_dir = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.backend_availability_zone = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.backend_host = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.chap_password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.chap_username = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.chiscsi_conf = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.disk_geometry = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_client_cert = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_data_namespace = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.driver_use_ssl = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.extra_capabilities = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.filter_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.goodness_function = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iser_helper = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iser_ip_address = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iser_port = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.iser_target_prefix = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_host = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_login = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_mount_options = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_password = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_private_key = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_share_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_ssh_port = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.num_shell_tries = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.nvmet_port_id = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.replication_device = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.report_discard_supported = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.reserved_percentage = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.scst_target_driver = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.storage_protocol = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_helper = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_ip_address = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_port = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_prefix = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_protocol = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.trace_flags = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.use_chap_auth = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_clear = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_clear_size = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] QuobyteHD.volumes_dir = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_notifications.driver = [] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] key_manager.fixed_key = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.barbican_api_version = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.barbican_endpoint = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.barbican_endpoint_type = public {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.barbican_region_name = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.cafile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.collect_timing = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.number_of_retries = 60 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.retry_delay = 1 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.send_service_user_token = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.split_loggers = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.verify_ssl = True {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican.verify_ssl_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.auth_section = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.auth_type = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.cafile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.certfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.collect_timing = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.insecure = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.keyfile = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.split_loggers = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] barbican_service_user.timeout = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.approle_role_id = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.approle_secret_id = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.auth_method = approle {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.auth_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.kv_mountpoint = secret {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.kv_path = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.kv_version = 2 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.namespace = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.root_token_id = **** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.ssl_ca_crt_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.timeout = 60.0 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.token_file = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.token_role = None {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.use_ssl = False {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:24 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] ******************************************************************************** {{(pid=93724) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 16:14:24 devstack quobyte-client[93975]: Reading configuration file: /etc/quobyte/client.cfg Aug 17 16:14:24 devstack quobyte-client[93975]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=93970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:24 devstack cinder-volume[93970]: INFO cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 ... Aug 17 16:14:24 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee -c /etc/quobyte/client-cinder.cfg {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:24 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee -c /etc/quobyte/client-cinder.cfg Aug 17 16:14:24 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:25 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.398s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:25 devstack cinder-volume[93970]: INFO cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 succeeded Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=93970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.413s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:25 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:25 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:25 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.278s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:25 devstack cinder-volume[93970]: INFO cinder.volume.driver [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Driver hasn't implemented _init_vendor_properties() Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.volume.driver [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7232513427734, 'free_capacity_gb': 1775.7232513427734, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93970) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_db.sqlalchemy.engines [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG dbcounter [-] [93970] Writer thread running {{(pid=93970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.db.api [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Building query based on filter {{(pid=93970) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.image.image_utils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93970) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 16:14:25 devstack cinder-volume[93970]: INFO cinder.keymgr.migration [None req-c1113fdd-861b-421b-a494-87902b871e0b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=93970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=93970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:25 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:25 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:25 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.252s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:25 devstack cinder-volume[93970]: DEBUG cinder.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Notifying Schedulers of capabilities ... {{(pid=93970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:14:26 devstack cinder-volume[93970]: INFO cinder.volume.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Driver initialization completed successfully. Aug 17 16:14:26 devstack cinder-volume[93970]: INFO cinder.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Initiating service 3 cleanup Aug 17 16:14:26 devstack cinder-volume[93970]: INFO cinder.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Service 3 cleanup completed. Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG cinder.service [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Creating RPC server for service cinder-volume {{(pid=93970) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG cinder.service [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93970) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 16:14:26 devstack cinder-volume[93970]: INFO cinder.volume.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=93970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=93970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:26 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:26 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:26 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:26 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.309s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:26 devstack cinder-volume[93970]: INFO cinder.volume.manager [None req-b78ec2a2-68fe-4563-8e99-a6429545998c None None] Driver post RPC initialization completed successfully. Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=93970) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG cinder.volume.drivers.quobyte [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=93970) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93970) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:31 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:31 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:31 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG oslo_concurrency.processutils [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.237s {{(pid=93970) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:31 devstack cinder-volume[93970]: DEBUG cinder.manager [None req-1b09f558-b3ce-409e-ad47-856b2fb6c690 None None] Notifying Schedulers of capabilities ... {{(pid=93970) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG dbcounter [-] [93724] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93724) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:34 devstack cinder-volume[93724]: INFO oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Caught SIGTERM, stopping children Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Acquiring lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Acquired lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Releasing lock "singleton_lock" {{(pid=93724) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Stop services. {{(pid=93724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 17 16:14:34 devstack cinder-volume[93724]: DEBUG oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Killing children. {{(pid=93724) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 17 16:14:34 devstack cinder-volume[93724]: INFO oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Waiting on 1 children to exit Aug 17 16:14:36 devstack cinder-volume[93970]: DEBUG dbcounter [-] [93970] Writing DB stats cinder:SELECT=2 {{(pid=93970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:36 devstack cinder-volume[93970]: DEBUG dbcounter [-] [93970] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:39 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Acquiring lock "singleton_lock" {{(pid=93970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:39 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Acquired lock "singleton_lock" {{(pid=93970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:39 devstack cinder-volume[93970]: DEBUG oslo_concurrency.lockutils [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Releasing lock "singleton_lock" {{(pid=93970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:39 devstack cinder-volume[93970]: WARNING amqp [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 16:14:39 devstack cinder-volume[93970]: WARNING amqp [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 17 16:14:39 devstack cinder-volume[93724]: INFO oslo_service.backend._eventlet.service [None req-b377df5d-d67c-4627-a8f7-2c45eaff26c7 None None] Child 93970 exited with status 0 Aug 17 16:14:40 devstack cinder-volume[94268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 17 16:14:40 devstack cinder-volume[94268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 16:14:40 devstack cinder-volume[94268]: we strongly recommend against using it for new projects. Aug 17 16:14:40 devstack cinder-volume[94268]: If you are already using Eventlet, we recommend migrating to a different Aug 17 16:14:40 devstack cinder-volume[94268]: framework. For more detail see Aug 17 16:14:40 devstack cinder-volume[94268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 16:14:40 devstack cinder-volume[94268]: import eventlet # noqa Aug 17 16:14:43 devstack cinder-volume[94268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 17 16:14:43 devstack cinder-volume[94268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 17 16:14:43 devstack cinder-volume[94268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 17 16:14:43 devstack cinder-volume[94268]: INFO dbcounter [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Registered counter for database cinder Aug 17 16:14:43 devstack cinder-volume[94268]: DEBUG oslo_db.sqlalchemy.engines [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG dbcounter [-] [94268] Writer thread running {{(pid=94268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:14:44 devstack cinder-volume[94268]: INFO cinder.rpc [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 17 16:14:44 devstack cinder-volume[94268]: INFO cinder.rpc [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_db.sqlalchemy.engines [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:44 devstack cinder-volume[94268]: INFO cinder.volume.manager [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Determined volume DB was empty at startup. Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG cinder.volume.manager [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94268) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 17 16:14:44 devstack cinder-volume[94268]: WARNING stevedore.named [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 17 16:14:44 devstack cinder-volume[94268]: WARNING castellan.key_manager [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:14:44 devstack cinder-volume[94268]: WARNING cinder.keymgr.conf_key_mgr [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 17 16:14:44 devstack cinder-volume[94268]: INFO cinder.volume.manager [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_db.sqlalchemy.engines [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:44 devstack cinder-volume[94268]: INFO oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Starting 1 workers Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Started child 94468 {{(pid=94268) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Full set of CONF: {{(pid=94268) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] ******************************************************************************** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] Configuration options gathered from: {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] ================================================================================ {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 17 16:14:44 devstack cinder-volume[94468]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] allow_availability_zone_fallback = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] allow_compression_on_image_upload = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] allowed_direct_url_schemes = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] api_rate_limit = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] auth_strategy = keystone {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_availability_zone = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_host = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_stats_polling_interval = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backup_api_class = cinder.backup.api.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backup_name_template = backup-%s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backup_use_same_host = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backup_use_temp_snapshot = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] chap_password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] chap_username = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_internal_tenant_project_id = 7d2a2320382d453fb464f32a1515a581 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_internal_tenant_user_id = 4dc9b5c29b1746379fbc476d09d73820 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cluster = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] compression_format = gzip {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] compute_api_class = cinder.compute.nova.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] config_dir = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] config_source = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] control_exchange = openstack {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] debug = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] default_availability_zone = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] default_group_type = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] default_volume_type = QuobyteHD {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] disk_geometry = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_client_cert = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_client_cert_key = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_data_namespace = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_ssl_cert_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_ssl_cert_verify = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] driver_use_ssl = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] enable_new_services = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] enable_unsupported_driver = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] enabled_backends = ['QuobyteHD'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] enforce_multipath_for_image_xfer = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] filter_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_api_insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_api_servers = ['http://192.168.122.201/image'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_api_ssl_compression = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_ca_certificates_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_catalog_info = image:glance:publicURL {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_num_retries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance_request_timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] goodness_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] graceful_shutdown_timeout = 5 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] group_api_class = cinder.group.api.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] host = devstack {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_compress_on_upload = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_conversion_address_space_limit = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_conversion_cpu_limit = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_conversion_disable = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_upload_use_cinder_backend = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_upload_use_internal_tenant = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_volume_cache_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_volume_cache_max_count = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] image_volume_cache_max_size_gb = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] init_host_max_objects_retrieval = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] instance_format = [instance: %(uuid)s] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iscsi_target_flags = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iscsi_write_cache = on {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iser_helper = tgtadm {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iser_ip_address = 192.168.122.201 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iser_port = 3260 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_color = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_config_append = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_dir = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_options = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_rotate_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_rotate_interval_type = days {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] log_rotation_type = none {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] max_age = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] max_logfile_count = 30 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] max_logfile_size_mb = 200 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] max_over_subscription_ratio = 20.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] message_reap_interval = 86400 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] message_ttl = 2592000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Starting volume driver QuobyteDriver (1.2) Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94468) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] migration_create_volume_timeout_secs = 300 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] monkey_patch = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] monkey_patch_modules = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] my_ip = 192.168.122.201 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] no_snapshot_gb_quota = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] num_iser_scan_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] num_shell_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] num_volume_device_scan_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] nvmeof_conn_info_version = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] nvmet_ns_id = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] nvmet_port_id = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_max_limit = 1000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_ext_list = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_listen_port = 8776 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_use_ssl = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] osapi_volume_workers = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] per_volume_size_limit = -1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] periodic_fuzzy_delay = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] periodic_interval = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] public_endpoint = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] publish_errors = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_backup_gigabytes = 1000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_backups = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_gigabytes = 1000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_groups = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_snapshots = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] quota_volumes = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] rate_limit_burst = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] rate_limit_except_level = CRITICAL {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] rate_limit_interval = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] reinit_driver_count = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] replication_device = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] report_discard_supported = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] report_interval = 120 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] reservation_clean_interval = 86400 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] reservation_expire = 86400 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] reserved_image_namespaces = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] reserved_percentage = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] rpc_response_timeout = 120 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] run_external_periodic_tasks = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] scst_target_driver = iscsi {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] scst_target_iqn_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_down_time = 720 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] shell_completion = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] snapshot_name_template = snapshot-%s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] split_loggers = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] state_path = /opt/stack/data/cinder {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] storage_availability_zone = nova {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] storage_protocol = iSCSI {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] syslog_log_facility = LOG_USER {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_helper = lioadm {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_ip_address = 192.168.122.201 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_port = 3260 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_protocol = iscsi {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] target_secondary_ip_addresses = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] trace_flags = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] transport_url = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] until_refresh = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_chap_auth = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_default_quota_class = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_journal = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_json = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_multipath_for_image_xfer = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_stderr = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] use_syslog = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] verify_glance_signatures = enabled {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_api_class = cinder.volume.api.API {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_backend_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_clear = zero {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_clear_ionice = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_clear_size = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_copy_bps_limit = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_dd_blocksize = 1M {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_name_template = volume-%s {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_service_inithost_offload = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volume_usage_audit_period = month {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] zoning_mode = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_concurrency.disable_process_locking = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.auth_section = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.auth_type = password {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.auth_version = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.cache = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.include_service_catalog = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.interface = public {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_password = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcache_username = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.region_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.service_type = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.201/identity {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.backend = dogpile.cache.null {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.backend_argument = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.backend_expiration_time = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.config_prefix = cache.oslo {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.debug_cache_backend = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.enable_retry_client = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.enable_socket_keepalive = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.expiration_time = 600 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.hashclient_retry_attempts = 2 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_dead_retry = 300 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_pool_maxsize = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_sasl_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.proxies = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.redis_db = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.redis_server = localhost:6379 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.retry_attempts = 2 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.retry_delay = 0.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.socket_keepalive_count = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.socket_keepalive_idle = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94468) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 17 16:14:44 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.socket_keepalive_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.socket_timeout = 1.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.tls_allowed_ciphers = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.tls_cafile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.tls_certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Running cmd (subprocess): mount.quobyte {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.tls_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.tls_keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cache.username = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] coordination.backend_url = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.asyncio_connection = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.asyncio_slave_connection = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.backend = sqlalchemy {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.connection = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.connection_debug = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.connection_parameters = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.connection_recycle_time = 3600 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.connection_trace = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.db_inc_retry_interval = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.db_max_retries = 20 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.db_max_retry_interval = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.db_retry_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.max_overflow = 50 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.max_pool_size = 5 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.max_retries = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.mysql_wsrep_sync_wait = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.pool_timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.retry_interval = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.slave_connection = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.sqlite_synchronous = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.synchronous_reader = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] database.use_db_reconnect = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.connection_string = messaging:// {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.es_doc_type = notification {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.es_scroll_size = 10000 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.es_scroll_time = 2m {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.filter_error_trace = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.hmac_keys = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.sentinel_service_name = mymaster {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.socket_timeout = 0.1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.trace_requests = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler.trace_sqlalchemy = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler_jaeger.process_tags = {} {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler_jaeger.service_name_prefix = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] profiler_otlp.service_name_prefix = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.enforce_new_defaults = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.policy_default_rule = default {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.policy_file = policy.yaml {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.group = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.helper_command = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] privsep_osbrick.user = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.group = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.helper_command = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] cinder_sys_admin.user = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.auth_section = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.auth_type = password {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.cafile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.collect_timing = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.send_service_user_token = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.split_loggers = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] service_user.timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.auth_section = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.auth_type = password {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.collect_timing = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.region_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.split_loggers = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] glance.timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.backend_availability_zone = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.chap_password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.chap_username = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.disk_geometry = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_client_cert = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_client_cert_key = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_data_namespace = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.driver_use_ssl = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.extra_capabilities = {} {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.filter_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.goodness_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iscsi_target_flags = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iscsi_write_cache = on {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iser_helper = tgtadm {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iser_ip_address = 192.168.122.201 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iser_port = 3260 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_host = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_login = admin {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_mount_options = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_private_key = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_share_path = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.num_shell_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack quobyte-client[94469]: Reading configuration file: /etc/quobyte/client.cfg Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.quobyte_volume_url = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.replication_device = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.report_discard_supported = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack quobyte-client[94469]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.reserved_percentage = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_helper = tgtadm {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_ip_address = 192.168.122.201 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_port = 3260 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_protocol = iscsi {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.trace_flags = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.unique_fqdn_network = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.use_chap_auth = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_backend_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_clear = zero {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_clear_ionice = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_clear_size = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_reports.file_event_handler = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_reports.log_dir = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.backend_availability_zone = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.backend_host = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.chap_password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.chap_username = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.chiscsi_conf = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.disk_geometry = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_client_cert = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_data_namespace = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.driver_use_ssl = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.extra_capabilities = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.filter_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.goodness_function = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iser_helper = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iser_ip_address = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iser_port = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.iser_target_prefix = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_host = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_login = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_mount_options = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_password = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_private_key = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_share_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_ssh_port = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.num_shell_tries = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.nvmet_port_id = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.replication_device = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.report_discard_supported = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.reserved_percentage = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.scst_target_driver = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.storage_protocol = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_helper = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_ip_address = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_port = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_prefix = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_protocol = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.trace_flags = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.use_chap_auth = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_clear = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_clear_size = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] QuobyteHD.volumes_dir = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:44 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_notifications.driver = [] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_notifications.retry = -1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] key_manager.fixed_key = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.barbican_api_version = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.barbican_endpoint = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.barbican_endpoint_type = public {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.barbican_region_name = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.cafile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.collect_timing = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.number_of_retries = 60 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.retry_delay = 1 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.send_service_user_token = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.split_loggers = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.verify_ssl = True {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican.verify_ssl_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.auth_section = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.auth_type = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.cafile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.certfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.collect_timing = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.insecure = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.keyfile = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.split_loggers = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] barbican_service_user.timeout = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.approle_role_id = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.approle_secret_id = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.auth_method = approle {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.auth_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.kv_mountpoint = secret {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.kv_path = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.kv_version = 2 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.namespace = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.root_token_id = **** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.ssl_ca_crt_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.timeout = 60.0 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.token_file = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.token_role = None {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.use_ssl = False {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 17 16:14:44 devstack cinder-volume[94268]: DEBUG oslo_service.backend._eventlet.service [None req-ce86f873-d2c3-471b-96d7-53a2def7cea2 None None] ******************************************************************************** {{(pid=94268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 17 16:14:44 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.254s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:44 devstack cinder-volume[94468]: INFO cinder.volume.driver [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Driver hasn't implemented _init_vendor_properties() Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.driver [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864204406738, 'free_capacity_gb': 1775.6864204406738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94468) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_db.sqlalchemy.engines [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94468) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writer thread running {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.db.api [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Building query based on filter {{(pid=94468) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94468) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.keymgr.migration [None req-6aa12571-4170-4dbb-a7aa-0d77351d0a82 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 17 16:14:45 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:45 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:45 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.269s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Driver initialization completed successfully. Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Initiating service 3 cleanup Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Service 3 cleanup completed. Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG cinder.service [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Creating RPC server for service cinder-volume {{(pid=94468) start /opt/stack/cinder/cinder/service.py:231}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG cinder.service [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94468) start /opt/stack/cinder/cinder/service.py:237}} Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:14:45 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:14:45 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:14:45 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Aug 17 16:14:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.279s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:14:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c8a9945-aa51-42b3-b3e3-3c5fcf1df72d None None] Driver post RPC initialization completed successfully. Aug 17 16:14:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:14:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 6 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:14:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:14:54 devstack cinder-volume[94268]: DEBUG dbcounter [-] [94268] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:55 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=2 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:14:55 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:15:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:15:46 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:15:46 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:15:47 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Aug 17 16:15:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.316s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:15:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:15:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:15:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 6 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:15:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:16:20 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Flow 'volume_create_manager' (591ef307-183c-4d71-b335-a0d52a3c0032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddbdbb0-9141-4d76-b677-1431f40283ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddbdbb0-9141-4d76-b677-1431f40283ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2041041377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626cee70-dcb6-4adb-92ef-114616693c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55ef4fc0ab54693a43ad94f9216ee40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:21Z,use_quota=True,user_id='fc5c9c548750430fbd8cb3bc441b26b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccb2ada-6ace-420e-b93c-074575cf3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccb2ada-6ace-420e-b93c-074575cf3b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b943051-9431-4ab2-addd-96b76dadd5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b943051-9431-4ab2-addd-96b76dadd5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626cee70-dcb6-4adb-92ef-114616693c75', 'volume_name': 'volume-626cee70-dcb6-4adb-92ef-114616693c75', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65e3d57-7d38-4400-b152-7216cf1412c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65e3d57-7d38-4400-b152-7216cf1412c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d62a5-1887-42b2-ab46-e44ded37f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Volume 626cee70-dcb6-4adb-92ef-114616693c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626cee70-dcb6-4adb-92ef-114616693c75', 'volume_size': 1} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2041041377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626cee70-dcb6-4adb-92ef-114616693c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55ef4fc0ab54693a43ad94f9216ee40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:21Z,use_quota=True,user_id='fc5c9c548750430fbd8cb3bc441b26b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Creating volume 626cee70-dcb6-4adb-92ef-114616693c75 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:16:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:16:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:21 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 1073741824 Aug 17 16:16:21 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:22 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 1073741824" returned: 0 in 1.674s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:23 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 Aug 17 16:16:23 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:23 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75" returned: 0 in 0.915s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] <== create_volume: return (2787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.802s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d62a5-1887-42b2-ab46-e44ded37f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626cee70-dcb6-4adb-92ef-114616693c75', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e26be37-e03a-4ebd-ad00-7a1d497313e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Volume volume-626cee70-dcb6-4adb-92ef-114616693c75 (626cee70-dcb6-4adb-92ef-114616693c75): created successfully Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e26be37-e03a-4ebd-ad00-7a1d497313e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Flow 'volume_create_manager' (591ef307-183c-4d71-b335-a0d52a3c0032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-92a44ca0-72dc-4294-b49e-f769e17542cb tempest-DeleteServersTestJSON-1377386676 None] Created volume successfully. Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Flow 'volume_create_manager' (e70872ca-9725-415e-8fc6-550e2257a60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d0172d-c717-45ce-81a0-19ab7ecefc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d0172d-c717-45ce-81a0-19ab7ecefc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2019637633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dde8fa2-bb62-40c5-9548-48c1ad28068c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cd3cd840624a1e80b93835ae529516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:30Z,use_quota=True,user_id='f6a562baef9a41a385638171fedd6bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8cb37-277b-4942-b9cf-c9161da654c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d8cb37-277b-4942-b9cf-c9161da654c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870f4f6f-1091-4526-9776-b483428a579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870f4f6f-1091-4526-9776-b483428a579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dde8fa2-bb62-40c5-9548-48c1ad28068c', 'volume_name': 'volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371e8f59-9aa8-4c8d-84a2-9bfae874accd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (371e8f59-9aa8-4c8d-84a2-9bfae874accd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ac885b-278a-40f5-843e-b283892fc14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Volume 8dde8fa2-bb62-40c5-9548-48c1ad28068c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c', 'volume_size': 1} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2019637633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dde8fa2-bb62-40c5-9548-48c1ad28068c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05cd3cd840624a1e80b93835ae529516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:30Z,use_quota=True,user_id='f6a562baef9a41a385638171fedd6bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Creating volume 8dde8fa2-bb62-40c5-9548-48c1ad28068c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:16:29 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:16:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:30 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c 1073741824 Aug 17 16:16:30 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:31 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c 1073741824" returned: 0 in 1.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:31 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c Aug 17 16:16:31 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:32 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c" returned: 0 in 1.105s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ac885b-278a-40f5-843e-b283892fc14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a8997b-353d-4b20-b23c-02527ecda1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Volume volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c (8dde8fa2-bb62-40c5-9548-48c1ad28068c): created successfully Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a8997b-353d-4b20-b23c-02527ecda1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Flow 'volume_create_manager' (e70872ca-9725-415e-8fc6-550e2257a60a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-77a335ab-9270-48e8-bf0d-0e43befbad3d tempest-VolumesAdminNegativeTest-1627045761 None] Created volume successfully. Aug 17 16:16:32 devstack cinder-volume[94468]: WARNING py.warnings [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 17 16:16:32 devstack cinder-volume[94468]: .first() Aug 17 16:16:32 devstack cinder-volume[94468]: Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-626cee70-dcb6-4adb-92ef-114616693c75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5dc8aea8-a08a-40b8-ab97-5d413cec51e2', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:16:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-de655d90-aa5d-4d4e-b7a2-020e18ff1779 req-c1a1af4a-542a-458b-8b87-8b584adca2cb tempest-DeleteServersTestJSON-1377386676 None] attachment_update completed successfully. Aug 17 16:16:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Acquiring lock "cinder-8dde8fa2-bb62-40c5-9548-48c1ad28068c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:16:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "cinder-8dde8fa2-bb62-40c5-9548-48c1ad28068c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:16:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Acquiring lock "cinder-quobyte-8dde8fa2-bb62-40c5-9548-48c1ad28068c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:16:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "cinder-quobyte-8dde8fa2-bb62-40c5-9548-48c1ad28068c" acquired by "delete_volume" :: waited 0.062s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:16:34 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplu2n8jll/privsep.sock'] Aug 17 16:16:34 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplu2n8jll/privsep.sock Aug 17 16:16:34 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: Aug 17 16:16:37 devstack cinder-volume[94468]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 17 16:16:37 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:37 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Spawned new privsep daemon via rootwrap Aug 17 16:16:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Accepted privsep connection to /tmp/tmplu2n8jll/privsep.sock {{(pid=94468) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 17 16:16:37 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 17 16:16:37 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 17 16:16:37 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 17 16:16:37 devstack cinder-volume[94468]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96365 Aug 17 16:16:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[45437a06-8d04-46b3-a6ce-47845540f6d5]: (2,) {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:16:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c57bfb-03b2-4c33-8828-ec69307afb6d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:16:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:38 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c Aug 17 16:16:38 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Flow 'volume_create_manager' (90e5fbf4-ff4d-40ae-8169-72ee634e81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0642dd-d063-4da9-83c0-aae53f82c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0642dd-d063-4da9-83c0-aae53f82c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2032923779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ae823-6dd0-4bc6-a4c8-935813a0b4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8632679086b745aeab0b5ee6f8405ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:38Z,use_quota=True,user_id='06a4cb1b273f44e08b144e774a7a4781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce74bae3-4931-477f-80f3-a0041d1b69eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce74bae3-4931-477f-80f3-a0041d1b69eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb218f11-50cf-4b2e-a2df-6e836c6942c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb218f11-50cf-4b2e-a2df-6e836c6942c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085ae823-6dd0-4bc6-a4c8-935813a0b4e0', 'volume_name': 'volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b18d193-e09c-40fe-8ce5-7f199af2111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b18d193-e09c-40fe-8ce5-7f199af2111f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a13e16-4aab-4abc-85d7-af75f40ba8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Volume 085ae823-6dd0-4bc6-a4c8-935813a0b4e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0', 'volume_size': 1} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2032923779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085ae823-6dd0-4bc6-a4c8-935813a0b4e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8632679086b745aeab0b5ee6f8405ea1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:16:38Z,use_quota=True,user_id='06a4cb1b273f44e08b144e774a7a4781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Creating volume 085ae823-6dd0-4bc6-a4c8-935813a0b4e0 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:16:38 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:38 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c" returned: 0 in 0.819s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:38 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 1073741824 Aug 17 16:16:38 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:38 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c Aug 17 16:16:38 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:39 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dde8fa2-bb62-40c5-9548-48c1ad28068c" returned: 0 in 1.115s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "cinder-quobyte-8dde8fa2-bb62-40c5-9548-48c1ad28068c" released by "delete_volume" :: held 5.576s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:16:39 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 1073741824" returned: 0 in 1.240s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:40 devstack cinder-volume[94468]: WARNING cinder.quota [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:16:40 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 Aug 17 16:16:40 devstack cinder-volume[94468]: WARNING cinder.quota [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:16:40 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:40 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Created reservations ['012b807a-bb3b-4451-889d-e29354c19688', '40fc92ac-af8b-4c30-a8dd-174c04bd0042', 'c5d1f5f1-9859-4b75-ac1f-075d35586d2a', '4b55bf49-384a-44c4-94f9-bc99a7807c2c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:16:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:41 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:16:41 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:41 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" returned: 0 in 1.035s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] <== create_volume: return (2591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a13e16-4aab-4abc-85d7-af75f40ba8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81868253-9cf5-4722-bfee-cf4316309cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:16:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Volume volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 (085ae823-6dd0-4bc6-a4c8-935813a0b4e0): created successfully Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81868253-9cf5-4722-bfee-cf4316309cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Flow 'volume_create_manager' (90e5fbf4-ff4d-40ae-8169-72ee634e81cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:16:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-37010252-a60f-4dd9-9afe-adb9a15dcfe9 tempest-ServerRescueNegativeTestJSON-439192243 None] Created volume successfully. Aug 17 16:16:41 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.697s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:16:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Deleted volume successfully. Aug 17 16:16:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-26f35e03-0c00-4bc6-a52e-556248610f11 tempest-VolumesAdminNegativeTest-1627045761 None] Lock "cinder-8dde8fa2-bb62-40c5-9548-48c1ad28068c-delete_volume" released by "delete_volume" :: held 7.710s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:16:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-c87e3b9b-5aed-4740-b99c-6b5bb1e00037 req-c45f6c81-d8b3-4c04-aa92-b53a03c9f382 tempest-DeleteServersTestJSON-1377386676 None] Terminate volume connection completed successfully. Aug 17 16:16:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c87e3b9b-5aed-4740-b99c-6b5bb1e00037 req-c45f6c81-d8b3-4c04-aa92-b53a03c9f382 tempest-DeleteServersTestJSON-1377386676 None] Deleting attachment 5dc8aea8-a08a-40b8-ab97-5d413cec51e2. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:46 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:16:46 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:47 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.550s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:16:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:16:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 8 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:16:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "cinder-626cee70-dcb6-4adb-92ef-114616693c75-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "cinder-626cee70-dcb6-4adb-92ef-114616693c75-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "cinder-quobyte-626cee70-dcb6-4adb-92ef-114616693c75" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "cinder-quobyte-626cee70-dcb6-4adb-92ef-114616693c75" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf72bfd-0986-45d1-bc48-6a7f010053be]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:16:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:48 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 Aug 17 16:16:48 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:49 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75" returned: 0 in 0.921s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:49 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75 Aug 17 16:16:49 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:49 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-626cee70-dcb6-4adb-92ef-114616693c75" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "cinder-quobyte-626cee70-dcb6-4adb-92ef-114616693c75" released by "delete_volume" :: held 1.512s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Created reservations ['ec1df492-2707-4f25-9ab6-72e67933583c', '4101e54c-76da-420a-bb41-db81ea65a11e', 'e07d9b35-c546-41ca-9636-d42d34686941', '0de876c2-4428-4213-ab48-699148b1bacb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:16:50 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:16:50 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:16:50 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.412s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:16:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Deleted volume successfully. Aug 17 16:16:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d094c3a-975c-4fad-8f1e-f1607a6f9474 tempest-DeleteServersTestJSON-1377386676 None] Lock "cinder-626cee70-dcb6-4adb-92ef-114616693c75-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:17:00 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:17:00 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=27,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Acquiring lock "cinder-085ae823-6dd0-4bc6-a4c8-935813a0b4e0-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "cinder-085ae823-6dd0-4bc6-a4c8-935813a0b4e0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Acquiring lock "cinder-quobyte-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "cinder-quobyte-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c256487-a755-439c-83d9-41a3c05e6e21]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:12 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 Aug 17 16:17:12 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:12 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" returned: 0 in 0.660s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:13 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0 Aug 17 16:17:13 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:13 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" returned: 0 in 0.482s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "cinder-quobyte-085ae823-6dd0-4bc6-a4c8-935813a0b4e0" released by "delete_volume" :: held 1.212s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Created reservations ['5a69fd8c-a5a8-4d55-b453-ae7feb392634', '01584666-02e4-4bce-9a07-f3696bbaa10f', 'e75b89ac-58d1-40d3-9017-b374c96d0dc6', '69ad9609-736a-438c-b3c0-88b8d55e1cc9'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:17:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:13 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:17:13 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:14 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.540s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:14 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:17:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Deleted volume successfully. Aug 17 16:17:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74072bf2-2ab9-4312-8150-17ac5855aa28 tempest-ServerRescueNegativeTestJSON-439192243 None] Lock "cinder-085ae823-6dd0-4bc6-a4c8-935813a0b4e0-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:17:23 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:17:24 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:17:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:46 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:17:46 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Flow 'volume_create_manager' (2e80415f-73d8-4055-8946-86b788ebeaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52fc402-044f-490b-828f-93bb1b043abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52fc402-044f-490b-828f-93bb1b043abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-993829800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f301e71-59d3-4516-b38d-e8ede3779d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5b916137b74901af39ac17aee41280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:17:47Z,use_quota=True,user_id='a45b1a68086c43b8a72ca2994ada91be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f9fbbd-48b7-42c1-ae02-4433772dd290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f9fbbd-48b7-42c1-ae02-4433772dd290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353911d-d60d-42f7-9ac7-9864b975a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353911d-d60d-42f7-9ac7-9864b975a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f301e71-59d3-4516-b38d-e8ede3779d2d', 'volume_name': 'volume-2f301e71-59d3-4516-b38d-e8ede3779d2d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:47 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a610b8-ab77-4b87-ac18-4378f5ba66ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a610b8-ab77-4b87-ac18-4378f5ba66ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55ae076-973b-4b43-9cac-8340d6c3ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:47 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Volume 2f301e71-59d3-4516-b38d-e8ede3779d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f301e71-59d3-4516-b38d-e8ede3779d2d', 'volume_size': 1} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-993829800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f301e71-59d3-4516-b38d-e8ede3779d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e5b916137b74901af39ac17aee41280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:17:47Z,use_quota=True,user_id='a45b1a68086c43b8a72ca2994ada91be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Creating volume 2f301e71-59d3-4516-b38d-e8ede3779d2d {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:17:47 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.558s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:17:47 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d 1073741824 Aug 17 16:17:47 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:47 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d 1073741824" returned: 0 in 0.570s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:17:47 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d Aug 17 16:17:47 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:17:48 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d" returned: 0 in 0.482s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55ae076-973b-4b43-9cac-8340d6c3ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f301e71-59d3-4516-b38d-e8ede3779d2d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9e11aa-a70e-453c-b635-0c7369d6c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:17:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Volume volume-2f301e71-59d3-4516-b38d-e8ede3779d2d (2f301e71-59d3-4516-b38d-e8ede3779d2d): created successfully Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9e11aa-a70e-453c-b635-0c7369d6c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:17:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Flow 'volume_create_manager' (2e80415f-73d8-4055-8946-86b788ebeaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:17:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9e40798e-60e4-4e95-a239-153f80f91ee4 tempest-TaggedAttachmentsTest-475688140 None] Created volume successfully. Aug 17 16:17:58 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:17:58 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:18:24 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:18:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Flow 'volume_create_manager' (a419c5bf-a303-4d6e-8bfc-02e2ae3fc9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f253cc-f0a7-4231-b609-8cd71db2fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f253cc-f0a7-4231-b609-8cd71db2fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1501517243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c915ae-dccd-4d83-8366-a7a4c592ae44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c163adbcbdb846c28f551f6385987ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:25Z,use_quota=True,user_id='c768c85ad15f4b3b9780d3506cd65a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2312987-dd3d-40fa-a395-7d6c5c5bad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2312987-dd3d-40fa-a395-7d6c5c5bad04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7df987c-d92a-47ce-a48a-20772a51dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7df987c-d92a-47ce-a48a-20772a51dc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c915ae-dccd-4d83-8366-a7a4c592ae44', 'volume_name': 'volume-38c915ae-dccd-4d83-8366-a7a4c592ae44', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88918f1-3207-4a8e-a03e-b9d26c412d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88918f1-3207-4a8e-a03e-b9d26c412d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98caeba1-fc97-4e73-84fd-70744371829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Volume 38c915ae-dccd-4d83-8366-a7a4c592ae44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c915ae-dccd-4d83-8366-a7a4c592ae44', 'volume_size': 1} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1501517243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c915ae-dccd-4d83-8366-a7a4c592ae44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c163adbcbdb846c28f551f6385987ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:25Z,use_quota=True,user_id='c768c85ad15f4b3b9780d3506cd65a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Creating volume 38c915ae-dccd-4d83-8366-a7a4c592ae44 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:18:25 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:18:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:25 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 1073741824 Aug 17 16:18:25 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:26 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 1073741824" returned: 0 in 1.508s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:26 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 Aug 17 16:18:26 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:27 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98caeba1-fc97-4e73-84fd-70744371829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c915ae-dccd-4d83-8366-a7a4c592ae44', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631d3ff7-5a78-404d-8ef9-93c3380504d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Volume volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 (38c915ae-dccd-4d83-8366-a7a4c592ae44): created successfully Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631d3ff7-5a78-404d-8ef9-93c3380504d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Flow 'volume_create_manager' (a419c5bf-a303-4d6e-8bfc-02e2ae3fc9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f2831795-27c1-40b1-8019-f9e044f36579 tempest-ServersNegativeTestJSON-1438200903 None] Created volume successfully. Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Flow 'volume_create_manager' (0680370b-efd3-44c1-8eef-026f8ced4444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece2be06-4b64-4cf6-bf28-49d09c0c297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece2be06-4b64-4cf6-bf28-49d09c0c297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1338153260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c378ed6-1652-4d15-8d92-8f44eb5dcc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c163adbcbdb846c28f551f6385987ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:32Z,use_quota=True,user_id='c768c85ad15f4b3b9780d3506cd65a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99292eb-5e9f-4330-b041-1725208ade49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99292eb-5e9f-4330-b041-1725208ade49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4389d6-a112-4b13-b9f4-f8f2bdd3000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4389d6-a112-4b13-b9f4-f8f2bdd3000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c378ed6-1652-4d15-8d92-8f44eb5dcc91', 'volume_name': 'volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ccbb84-2001-4d88-a590-dc1c60e65e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ccbb84-2001-4d88-a590-dc1c60e65e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b351673e-9a74-4ea8-8c48-32c4e7afc507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Volume 3c378ed6-1652-4d15-8d92-8f44eb5dcc91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91', 'volume_size': 1} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1338153260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c378ed6-1652-4d15-8d92-8f44eb5dcc91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c163adbcbdb846c28f551f6385987ba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:32Z,use_quota=True,user_id='c768c85ad15f4b3b9780d3506cd65a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Creating volume 3c378ed6-1652-4d15-8d92-8f44eb5dcc91 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:18:32 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:18:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:32 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 1073741824 Aug 17 16:18:32 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:33 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 1073741824" returned: 0 in 1.079s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:33 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 Aug 17 16:18:33 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:33 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" returned: 0 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b351673e-9a74-4ea8-8c48-32c4e7afc507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f981cfb-a512-42f6-80c2-77e84afd656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Volume volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 (3c378ed6-1652-4d15-8d92-8f44eb5dcc91): created successfully Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f981cfb-a512-42f6-80c2-77e84afd656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Flow 'volume_create_manager' (0680370b-efd3-44c1-8eef-026f8ced4444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d5d4926a-f60c-47bc-8188-68dbfa23c757 tempest-ServersNegativeTestJSON-1438200903 None] Created volume successfully. Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "cinder-3c378ed6-1652-4d15-8d92-8f44eb5dcc91-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-3c378ed6-1652-4d15-8d92-8f44eb5dcc91-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "cinder-quobyte-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-quobyte-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef6da1b-c36f-4cf7-a6f1-3eaceac1307c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:18:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:35 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 Aug 17 16:18:35 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:35 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" returned: 0 in 0.593s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:35 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91 Aug 17 16:18:35 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:35 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-quobyte-3c378ed6-1652-4d15-8d92-8f44eb5dcc91" released by "delete_volume" :: held 1.001s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:18:35 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Created reservations ['6185c272-07d0-44c4-b6f3-69f20926c785', '5c822efc-5391-4948-82df-426012af0584', 'c7f9c1b6-f9f4-4eb9-8a7c-db79562afe7b', '2c41a9fb-1a96-4347-872c-b8c85e7cd83c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:36 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:18:36 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:36 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:18:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Deleted volume successfully. Aug 17 16:18:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6e37d698-f6b3-4990-a284-c0e2ec2ea708 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-3c378ed6-1652-4d15-8d92-8f44eb5dcc91-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "cinder-38c915ae-dccd-4d83-8366-a7a4c592ae44-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-38c915ae-dccd-4d83-8366-a7a4c592ae44-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "cinder-quobyte-38c915ae-dccd-4d83-8366-a7a4c592ae44" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-quobyte-38c915ae-dccd-4d83-8366-a7a4c592ae44" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cde288-0d21-4aaa-8605-6ad4aa0a9ead]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:37 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 Aug 17 16:18:37 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:37 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44" returned: 0 in 0.563s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:37 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44 Aug 17 16:18:37 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:38 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38c915ae-dccd-4d83-8366-a7a4c592ae44" returned: 0 in 0.293s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-quobyte-38c915ae-dccd-4d83-8366-a7a4c592ae44" released by "delete_volume" :: held 0.916s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Created reservations ['21db77d0-c897-4470-b2bd-3e3afd3ce665', 'f2c2690c-7724-4eee-9f39-3aca128f0115', '946dd545-42e3-4305-b93a-0b344e26490d', '2e865e81-9803-4ff3-870f-721ad3f29732'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:38 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:18:38 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:38 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.474s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:38 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:18:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Deleted volume successfully. Aug 17 16:18:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-32ce6489-1c91-485d-824d-cf36dc046f79 tempest-ServersNegativeTestJSON-1438200903 None] Lock "cinder-38c915ae-dccd-4d83-8366-a7a4c592ae44-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:46 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:18:46 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:47 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.311s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:18:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:18:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 8 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:18:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Flow 'volume_create_manager' (9c6bad3e-aec1-49dd-bc10-3b96769e66e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa890ccc-c3aa-4560-a1ca-89d71d945a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa890ccc-c3aa-4560-a1ca-89d71d945a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-804636858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600d8d92-6b88-49c0-a030-6d9375c38925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c1febed31a412782d17e5ea62d2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:50Z,use_quota=True,user_id='b41cd3b7c7f945e4af853734dcb46d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a030c-1a5b-44da-945f-467777007944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a030c-1a5b-44da-945f-467777007944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c202513c-2f02-4f91-9621-0f0f433282e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c202513c-2f02-4f91-9621-0f0f433282e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600d8d92-6b88-49c0-a030-6d9375c38925', 'volume_name': 'volume-600d8d92-6b88-49c0-a030-6d9375c38925', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44f76fd-7853-4aaa-8449-2e5cf50ee0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44f76fd-7853-4aaa-8449-2e5cf50ee0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339c7c82-fcee-43b3-900f-3b927c9cc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Volume 600d8d92-6b88-49c0-a030-6d9375c38925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600d8d92-6b88-49c0-a030-6d9375c38925', 'volume_size': 1} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-804636858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600d8d92-6b88-49c0-a030-6d9375c38925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c1febed31a412782d17e5ea62d2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:50Z,use_quota=True,user_id='b41cd3b7c7f945e4af853734dcb46d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Creating volume 600d8d92-6b88-49c0-a030-6d9375c38925 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:18:50 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:50 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 1073741824 Aug 17 16:18:50 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:50 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 1073741824" returned: 0 in 0.599s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:50 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 Aug 17 16:18:50 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:51 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925" returned: 0 in 0.411s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339c7c82-fcee-43b3-900f-3b927c9cc555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600d8d92-6b88-49c0-a030-6d9375c38925', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e6208-561a-4ff2-8483-6609e2047d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:51 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Volume volume-600d8d92-6b88-49c0-a030-6d9375c38925 (600d8d92-6b88-49c0-a030-6d9375c38925): created successfully Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e6208-561a-4ff2-8483-6609e2047d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Flow 'volume_create_manager' (9c6bad3e-aec1-49dd-bc10-3b96769e66e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-51a1844a-86e9-421e-895c-483062ac9d66 tempest-ServerActionsTestOtherA-726044476 None] Created volume successfully. Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Flow 'volume_create_manager' (6564278a-18af-48cc-a7d7-3d980c66a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6378827-5ec2-4f47-bf52-adc68d558e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6378827-5ec2-4f47-bf52-adc68d558e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1800003992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2677be3-64f7-456f-8947-ceccfc3b47ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dd274527934dce849faf4161eb493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:56Z,use_quota=True,user_id='b69b56f26c274b3893e539f1f70551c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3085b5f8-a216-481c-ada8-a428d9953ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3085b5f8-a216-481c-ada8-a428d9953ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176c722-0987-49d1-93de-34a159caef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3176c722-0987-49d1-93de-34a159caef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2677be3-64f7-456f-8947-ceccfc3b47ad', 'volume_name': 'volume-a2677be3-64f7-456f-8947-ceccfc3b47ad', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ca9c7-3d4a-44b5-a1f1-b85252bcedd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146ca9c7-3d4a-44b5-a1f1-b85252bcedd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca81991-c5ae-471c-ae22-119f58ba982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:56 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Volume a2677be3-64f7-456f-8947-ceccfc3b47ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2677be3-64f7-456f-8947-ceccfc3b47ad', 'volume_size': 1} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1800003992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2677be3-64f7-456f-8947-ceccfc3b47ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dd274527934dce849faf4161eb493d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:18:56Z,use_quota=True,user_id='b69b56f26c274b3893e539f1f70551c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Creating volume a2677be3-64f7-456f-8947-ceccfc3b47ad {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:18:56 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:18:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:56 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad 1073741824 Aug 17 16:18:56 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:57 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad 1073741824" returned: 0 in 1.090s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:18:58 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad Aug 17 16:18:58 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:18:58 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad" returned: 0 in 0.554s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca81991-c5ae-471c-ae22-119f58ba982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2677be3-64f7-456f-8947-ceccfc3b47ad', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e612b5-936e-4cf9-b17b-5db3b2c32bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:18:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Volume volume-a2677be3-64f7-456f-8947-ceccfc3b47ad (a2677be3-64f7-456f-8947-ceccfc3b47ad): created successfully Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e612b5-936e-4cf9-b17b-5db3b2c32bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:18:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Flow 'volume_create_manager' (6564278a-18af-48cc-a7d7-3d980c66a370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:18:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d90d7a3e-8070-4e34-8ec4-e8e4f4bd5441 tempest-AttachVolumeShelveTestJSON-111445825 None] Created volume successfully. Aug 17 16:19:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7571bb81-1edb-4619-9979-7844a0f73f8f req-a92e24f7-aee9-45bb-ae23-17be352de3e0 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7571bb81-1edb-4619-9979-7844a0f73f8f req-a92e24f7-aee9-45bb-ae23-17be352de3e0 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7571bb81-1edb-4619-9979-7844a0f73f8f req-a92e24f7-aee9-45bb-ae23-17be352de3e0 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-7571bb81-1edb-4619-9979-7844a0f73f8f req-a92e24f7-aee9-45bb-ae23-17be352de3e0 tempest-TaggedAttachmentsTest-475688140 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-2f301e71-59d3-4516-b38d-e8ede3779d2d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a182e81f-0304-43d5-b3bb-1b0290cd1194', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:19:00 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-7571bb81-1edb-4619-9979-7844a0f73f8f req-a92e24f7-aee9-45bb-ae23-17be352de3e0 tempest-TaggedAttachmentsTest-475688140 None] attachment_update completed successfully. Aug 17 16:19:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-be35ee20-528a-409e-b794-f9408c841314 req-cb483fa5-c056-452c-8527-768774bbeead tempest-TaggedAttachmentsTest-475688140 None] Terminate volume connection completed successfully. Aug 17 16:19:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-be35ee20-528a-409e-b794-f9408c841314 req-cb483fa5-c056-452c-8527-768774bbeead tempest-TaggedAttachmentsTest-475688140 None] Deleting attachment a182e81f-0304-43d5-b3bb-1b0290cd1194. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:19:17 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=31,cinder:SELECT=25,cinder:INSERT=9,cinder:DELETE=3 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:19:18 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=3 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:19:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-2004f7b7-f8c5-4adb-990e-a2f9cb79f832 req-6e7b7378-af03-47d4-a652-02bd524002ee tempest-AttachVolumeShelveTestJSON-111445825 None] No connector for attachment 98578eeb-5ff6-48b0-b952-05efd5f7289a; skipping storage backend terminate_connection call. {{(pid=94468) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 17 16:19:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-2004f7b7-f8c5-4adb-990e-a2f9cb79f832 req-6e7b7378-af03-47d4-a652-02bd524002ee tempest-AttachVolumeShelveTestJSON-111445825 None] Deleting attachment 98578eeb-5ff6-48b0-b952-05efd5f7289a. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:19:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "cinder-2f301e71-59d3-4516-b38d-e8ede3779d2d-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:19:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "cinder-2f301e71-59d3-4516-b38d-e8ede3779d2d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "cinder-quobyte-2f301e71-59d3-4516-b38d-e8ede3779d2d" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "cinder-quobyte-2f301e71-59d3-4516-b38d-e8ede3779d2d" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1151cf0-465e-43f3-b524-2f5f1d678ff4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:27 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d Aug 17 16:19:27 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:27 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d" returned: 0 in 0.428s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:27 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d Aug 17 16:19:27 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:27 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f301e71-59d3-4516-b38d-e8ede3779d2d" returned: 0 in 0.464s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "cinder-quobyte-2f301e71-59d3-4516-b38d-e8ede3779d2d" released by "delete_volume" :: held 0.971s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Created reservations ['c494bf6c-e722-4d5c-90db-f4abd5dbbd86', 'ee6f2163-d5cc-49b7-b8f1-927b683e45dc', 'e9df484f-3a51-40e3-a7f0-45b28c327bc6', '4b2cca3a-9b53-4639-b6dc-908ea18cdc96'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:28 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:19:28 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:28 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:19:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Deleted volume successfully. Aug 17 16:19:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0eda1f54-43d8-4072-9c7e-2b98c8ac4477 tempest-TaggedAttachmentsTest-475688140 None] Lock "cinder-2f301e71-59d3-4516-b38d-e8ede3779d2d-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:19:38 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:19:38 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:19:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-25902c49-a9bb-4ebb-bc66-b93099e56149 req-50a4cd96-e714-40a6-acd0-705a20de953a tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-25902c49-a9bb-4ebb-bc66-b93099e56149 req-50a4cd96-e714-40a6-acd0-705a20de953a tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-25902c49-a9bb-4ebb-bc66-b93099e56149 req-50a4cd96-e714-40a6-acd0-705a20de953a tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.083s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-25902c49-a9bb-4ebb-bc66-b93099e56149 req-50a4cd96-e714-40a6-acd0-705a20de953a tempest-ServerActionsTestOtherA-726044476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-600d8d92-6b88-49c0-a030-6d9375c38925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6807847-ab55-44c7-a6f1-b270bae213da', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:19:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-25902c49-a9bb-4ebb-bc66-b93099e56149 req-50a4cd96-e714-40a6-acd0-705a20de953a tempest-ServerActionsTestOtherA-726044476 None] attachment_update completed successfully. Aug 17 16:19:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-c484fb80-1e4b-43b2-a3cc-625572251ceb tempest-ServerActionsTestOtherA-726044476 None] Terminate volume connection completed successfully. Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-c484fb80-1e4b-43b2-a3cc-625572251ceb tempest-ServerActionsTestOtherA-726044476 None] Deleting attachment d6807847-ab55-44c7-a6f1-b270bae213da. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:46 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:19:46 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:47 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.673s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 8 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-8e4b2c1c-122f-48a3-bd5e-71dd8e157052 tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-8e4b2c1c-122f-48a3-bd5e-71dd8e157052 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-8e4b2c1c-122f-48a3-bd5e-71dd8e157052 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-8e4b2c1c-122f-48a3-bd5e-71dd8e157052 tempest-ServerActionsTestOtherA-726044476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-600d8d92-6b88-49c0-a030-6d9375c38925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92631060-bc48-4932-a2dd-24d70c2e59de', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:19:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-7eb3b2f6-f5ac-4323-9218-612b1bf80050 req-8e4b2c1c-122f-48a3-bd5e-71dd8e157052 tempest-ServerActionsTestOtherA-726044476 None] attachment_update completed successfully. Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (19fe488d-3dcb-4e6a-af08-3561f2717e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34477817-5828-4b29-a838-45eacd5eac42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34477817-5828-4b29-a838-45eacd5eac42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638242403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f66f8ad-055d-43fc-a2d7-2556e1e7d894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:19:53Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3162e755-413e-43fa-9a2f-13886d47a29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3162e755-413e-43fa-9a2f-13886d47a29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6012c41-0b2f-455a-ab95-d109ae6f02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6012c41-0b2f-455a-ab95-d109ae6f02b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f66f8ad-055d-43fc-a2d7-2556e1e7d894', 'volume_name': 'volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c806a75-c503-4f6d-8fdd-03d755e22a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c806a75-c503-4f6d-8fdd-03d755e22a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed1021a-a9a6-4a5b-bba6-e77e3ccbbf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:53 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Volume 4f66f8ad-055d-43fc-a2d7-2556e1e7d894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894', 'volume_size': 1} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638242403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f66f8ad-055d-43fc-a2d7-2556e1e7d894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:19:53Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Creating volume 4f66f8ad-055d-43fc-a2d7-2556e1e7d894 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:19:53 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:53 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 1073741824 Aug 17 16:19:53 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:53 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 1073741824" returned: 0 in 0.686s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:19:53 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 Aug 17 16:19:53 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:19:54 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" returned: 0 in 0.627s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed1021a-a9a6-4a5b-bba6-e77e3ccbbf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cc27e3-9e2b-4c8b-b61a-2f3aa8067cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:19:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Volume volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 (4f66f8ad-055d-43fc-a2d7-2556e1e7d894): created successfully Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5cc27e3-9e2b-4c8b-b61a-2f3aa8067cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:19:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (19fe488d-3dcb-4e6a-af08-3561f2717e23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:19:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-daf8f03b-d15d-4321-bc3a-50c4cf9fdc3c tempest-AttachVolumeNegativeTest-1332257649 None] Created volume successfully. Aug 17 16:19:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-84e06f28-1d00-498d-be1e-8b3f1982db7b req-918a7b9c-3d98-4f34-bff2-f1b4180a3ebc tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:19:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-84e06f28-1d00-498d-be1e-8b3f1982db7b req-918a7b9c-3d98-4f34-bff2-f1b4180a3ebc tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:19:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-84e06f28-1d00-498d-be1e-8b3f1982db7b req-918a7b9c-3d98-4f34-bff2-f1b4180a3ebc tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:19:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-84e06f28-1d00-498d-be1e-8b3f1982db7b req-918a7b9c-3d98-4f34-bff2-f1b4180a3ebc tempest-AttachVolumeNegativeTest-1332257649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '667ac880-856d-44c5-9161-bc7a73e6512b', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:19:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-84e06f28-1d00-498d-be1e-8b3f1982db7b req-918a7b9c-3d98-4f34-bff2-f1b4180a3ebc tempest-AttachVolumeNegativeTest-1332257649 None] attachment_update completed successfully. Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Flow 'volume_create_manager' (793265ae-9ed8-4e28-acee-3e36fdf5761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa3ffc7-9ddf-4dc2-9bcc-84d49373acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa3ffc7-9ddf-4dc2-9bcc-84d49373acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-586177290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dffefb-1b25-4909-ae76-365f04d6bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55af9038ed3b45659f9f25a1b91331b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:03Z,use_quota=True,user_id='2c3dee45ca3a495f945a837f94c8e7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13bc5f7-0344-4dca-b763-c65d641a8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13bc5f7-0344-4dca-b763-c65d641a8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04a85d9-16cb-460c-97f5-c7e4e3b50190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04a85d9-16cb-460c-97f5-c7e4e3b50190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6dffefb-1b25-4909-ae76-365f04d6bfa9', 'volume_name': 'volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bca4da-0249-483f-ac53-e46be2de9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bca4da-0249-483f-ac53-e46be2de9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec58608-953d-4b89-aa01-a2ffd164c36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:02 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume f6dffefb-1b25-4909-ae76-365f04d6bfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9', 'volume_size': 1} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-586177290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6dffefb-1b25-4909-ae76-365f04d6bfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55af9038ed3b45659f9f25a1b91331b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:03Z,use_quota=True,user_id='2c3dee45ca3a495f945a837f94c8e7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Creating volume f6dffefb-1b25-4909-ae76-365f04d6bfa9 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:02 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:02 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 1073741824 Aug 17 16:20:02 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:03 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 1073741824" returned: 0 in 0.807s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:03 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 Aug 17 16:20:03 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:04 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9" returned: 0 in 0.647s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec58608-953d-4b89-aa01-a2ffd164c36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3262d215-5f5a-4e89-9352-f60d2add90f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 (f6dffefb-1b25-4909-ae76-365f04d6bfa9): created successfully Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3262d215-5f5a-4e89-9352-f60d2add90f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Flow 'volume_create_manager' (793265ae-9ed8-4e28-acee-3e36fdf5761d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-74e98883-4afe-48fe-8098-8ef22673a8e3 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Created volume successfully. Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "cinder-f6dffefb-1b25-4909-ae76-365f04d6bfa9-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "cinder-f6dffefb-1b25-4909-ae76-365f04d6bfa9-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "cinder-quobyte-f6dffefb-1b25-4909-ae76-365f04d6bfa9" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "cinder-quobyte-f6dffefb-1b25-4909-ae76-365f04d6bfa9" acquired by "delete_volume" :: waited 0.048s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85802a3-edac-4af8-af8e-ac56603632eb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:05 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 Aug 17 16:20:05 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:06 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9" returned: 0 in 0.610s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:06 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9 Aug 17 16:20:06 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:06 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6dffefb-1b25-4909-ae76-365f04d6bfa9" returned: 0 in 0.572s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "cinder-quobyte-f6dffefb-1b25-4909-ae76-365f04d6bfa9" released by "delete_volume" :: held 1.271s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Created reservations ['3ca2377e-5331-4f5d-a50f-7737a54e9289', 'c0d5c41a-7109-457a-bd00-f87820dcd764', '0ebc1a26-51c1-4da5-a671-95bdcf426126', '6b3cdcc6-f444-4982-8b60-12f0deb25d4a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:07 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:20:07 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:07 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.431s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:07 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:20:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Deleted volume successfully. Aug 17 16:20:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a7941f48-7d4f-4778-9dfb-66592f3d5d01 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "cinder-f6dffefb-1b25-4909-ae76-365f04d6bfa9-delete_volume" released by "delete_volume" :: held 2.180s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Flow 'volume_create_manager' (529d2bf0-69f2-482b-a6e0-f61d0f743be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e662127-e2c2-4abb-bf07-a34fcb1b29e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e662127-e2c2-4abb-bf07-a34fcb1b29e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-49287976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55af9038ed3b45659f9f25a1b91331b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:09Z,use_quota=True,user_id='2c3dee45ca3a495f945a837f94c8e7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1152f022-d754-455f-8124-b7b1897b5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1152f022-d754-455f-8124-b7b1897b5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f596e8f-e613-492f-98b5-926e10769336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f596e8f-e613-492f-98b5-926e10769336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4', 'volume_name': 'volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9c1ea5-a35d-4e7f-ae5c-afb9ef47f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac9c1ea5-a35d-4e7f-ae5c-afb9ef47f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4745e6-40fa-4adf-864e-7791cd39f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume 4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4', 'volume_size': 1} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-49287976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55af9038ed3b45659f9f25a1b91331b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:09Z,use_quota=True,user_id='2c3dee45ca3a495f945a837f94c8e7db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Creating volume 4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:08 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:08 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 1073741824 Aug 17 16:20:08 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:09 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 1073741824" returned: 0 in 0.550s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:09 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 Aug 17 16:20:09 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:09 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" returned: 0 in 0.412s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4745e6-40fa-4adf-864e-7791cd39f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd972d-d66c-4cc6-89a1-2cc24c608bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:09 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Volume volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 (4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4): created successfully Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffd972d-d66c-4cc6-89a1-2cc24c608bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Flow 'volume_create_manager' (529d2bf0-69f2-482b-a6e0-f61d0f743be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a76a6a40-0cf0-4ac2-ba92-a1c77d146642 tempest-VolumeQuotasAdminTestJSON-1534051650 None] Created volume successfully. Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Acquiring lock "cinder-a2677be3-64f7-456f-8947-ceccfc3b47ad-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "cinder-a2677be3-64f7-456f-8947-ceccfc3b47ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Acquiring lock "cinder-quobyte-a2677be3-64f7-456f-8947-ceccfc3b47ad" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "cinder-quobyte-a2677be3-64f7-456f-8947-ceccfc3b47ad" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b9e682-5088-4948-b4bc-b622ac46ceca]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:11 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad Aug 17 16:20:11 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5d17691b-d4ef-433e-ab5a-ccbc55e62a46 tempest-VolumeQuotasAdminTestJSON-2068225936 None] Transfer volume completed successfully. Aug 17 16:20:12 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad" returned: 0 in 0.525s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:12 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad Aug 17 16:20:12 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Acquiring lock "cinder-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "cinder-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:12 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a2677be3-64f7-456f-8947-ceccfc3b47ad" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "cinder-quobyte-a2677be3-64f7-456f-8947-ceccfc3b47ad" released by "delete_volume" :: held 0.967s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Acquiring lock "cinder-quobyte-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "cinder-quobyte-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[227e08d4-2a13-409c-b218-719baacc1221]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Created reservations ['a5b936e2-003c-402c-949b-2995d1ceec7b', '647b5e30-3653-4012-b3c2-d537d1f37c66', '74b56def-d2f6-4e5f-a568-15bd8975b6f5', '767347a5-7d5e-4b33-a77d-7abec54dc5d1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:12 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 Aug 17 16:20:12 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:12 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:20:12 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:13 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" returned: 0 in 0.551s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:13 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:20:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Deleted volume successfully. Aug 17 16:20:13 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4 Aug 17 16:20:13 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1e0816f8-5052-47d9-86b0-ede76ac026f9 tempest-AttachVolumeShelveTestJSON-111445825 None] Lock "cinder-a2677be3-64f7-456f-8947-ceccfc3b47ad-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:13 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "cinder-quobyte-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4" released by "delete_volume" :: held 0.951s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Created reservations ['a0fc0bc2-5e91-4e59-9005-6621ca55ab7e', '60a49c10-6aec-495f-9e88-bed6f2f1c292', '5f27f5bc-fcfb-4522-8a54-35b0e63a00fc', '0f2cb3cc-ec8c-418d-b2e8-b298a35f73ee'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:13 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:20:13 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:14 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.559s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:14 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:20:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Deleted volume successfully. Aug 17 16:20:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-05049c4e-9db0-4341-973f-fcecdbd399da tempest-VolumeQuotasAdminTestJSON-682041110 None] Lock "cinder-4fbf19aa-bbe2-49ce-9fa3-0a55d5dd9dd4-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-0e4f58ad-e926-4c92-9357-0a82aa33eca3 req-dece52f3-9416-45db-b86f-3d8bc2df5b87 tempest-ServerActionsTestOtherA-726044476 None] Terminate volume connection completed successfully. Aug 17 16:20:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0e4f58ad-e926-4c92-9357-0a82aa33eca3 req-dece52f3-9416-45db-b86f-3d8bc2df5b87 tempest-ServerActionsTestOtherA-726044476 None] Deleting attachment 92631060-bc48-4932-a2dd-24d70c2e59de. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Flow 'volume_create_manager' (5ff8611c-53ba-41e1-a4fd-2dd688adc7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e53c7-3e93-42c6-b94a-37be7b7555be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e53c7-3e93-42c6-b94a-37be7b7555be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1021395854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dff5883-7caf-47d6-8a09-8c5915d46d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62ddd588ea4eed87edf1768b6d6fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:28Z,use_quota=True,user_id='c0a8ceaf4ae747c2a38bb32700e84eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fb60a9-3cb1-4447-aa6c-c747c65d3117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fb60a9-3cb1-4447-aa6c-c747c65d3117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767c8ab3-2a1b-45e0-bc02-2cdbfd262414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767c8ab3-2a1b-45e0-bc02-2cdbfd262414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dff5883-7caf-47d6-8a09-8c5915d46d3b', 'volume_name': 'volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf204ce6-2ad4-4e8f-803c-4b7f2fa1f4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf204ce6-2ad4-4e8f-803c-4b7f2fa1f4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b71207-6d8f-4a4d-9c7c-b85bb9e2001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Volume 8dff5883-7caf-47d6-8a09-8c5915d46d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b', 'volume_size': 1} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1021395854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dff5883-7caf-47d6-8a09-8c5915d46d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed62ddd588ea4eed87edf1768b6d6fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:28Z,use_quota=True,user_id='c0a8ceaf4ae747c2a38bb32700e84eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Creating volume 8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:27 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b 1073741824 Aug 17 16:20:27 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Flow 'volume_create_manager' (ff53d78f-8b04-4007-aff2-0cb90776d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a711705-cd9b-46ae-ac6a-5a62a8a63c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a711705-cd9b-46ae-ac6a-5a62a8a63c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-750919203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97904e4-6e88-434c-8ef5-487756f7aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353a4184dc0141a59f55133546f9568c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:28Z,use_quota=True,user_id='9bef5c1ad57c4f42be095c72d944c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e7ec5e-80f4-476b-84a4-cb7674475842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e7ec5e-80f4-476b-84a4-cb7674475842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c1c6b7-1912-4357-bda0-ce1c4a7369da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c1c6b7-1912-4357-bda0-ce1c4a7369da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97904e4-6e88-434c-8ef5-487756f7aca2', 'volume_name': 'volume-d97904e4-6e88-434c-8ef5-487756f7aca2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b2c68e-a787-4d16-982d-50f1072c2a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b2c68e-a787-4d16-982d-50f1072c2a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7f537e-c08a-476a-a520-4210e88376dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Volume d97904e4-6e88-434c-8ef5-487756f7aca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97904e4-6e88-434c-8ef5-487756f7aca2', 'volume_size': 1} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:28 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b 1073741824" returned: 0 in 0.521s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:28 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b Aug 17 16:20:28 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:28 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-750919203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97904e4-6e88-434c-8ef5-487756f7aca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353a4184dc0141a59f55133546f9568c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:28Z,use_quota=True,user_id='9bef5c1ad57c4f42be095c72d944c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Creating volume d97904e4-6e88-434c-8ef5-487756f7aca2 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:28 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:28 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 1073741824 Aug 17 16:20:28 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b71207-6d8f-4a4d-9c7c-b85bb9e2001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84437eb8-424e-4408-9c29-ae748870b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Volume volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b (8dff5883-7caf-47d6-8a09-8c5915d46d3b): created successfully Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84437eb8-424e-4408-9c29-ae748870b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Flow 'volume_create_manager' (5ff8611c-53ba-41e1-a4fd-2dd688adc7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-c9c6602e-5fe1-4a06-897b-21b11de46dab req-05a48f5c-f32b-44ce-bb90-b19885b0d8ad tempest-VolumesSnapshotsTestJSON-503439776 None] Created volume successfully. Aug 17 16:20:29 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 1073741824" returned: 0 in 0.519s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:29 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 Aug 17 16:20:29 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:29 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7f537e-c08a-476a-a520-4210e88376dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97904e4-6e88-434c-8ef5-487756f7aca2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabce297-50a0-41d3-a295-a982ab9f464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Volume volume-d97904e4-6e88-434c-8ef5-487756f7aca2 (d97904e4-6e88-434c-8ef5-487756f7aca2): created successfully Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabce297-50a0-41d3-a295-a982ab9f464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Flow 'volume_create_manager' (ff53d78f-8b04-4007-aff2-0cb90776d42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f34c0db8-530c-43d5-b043-445ee712b66c tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Created volume successfully. Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Creating offline snapshot 5cfff712-f696-4b05-aa29-6fe683458d93 of volume 8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d01544f-b1e3-4d33-8c01-39a074403d2e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:30 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b Aug 17 16:20:30 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:30 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b" returned: 0 in 0.510s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:30 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 1G Aug 17 16:20:30 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Flow 'volume_create_manager' (c7725593-98ec-4a50-bbc6-591b4bcf2bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9f251f-eade-452c-8bda-79382be86bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9f251f-eade-452c-8bda-79382be86bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1654462021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9259589-d700-424c-97f1-0f1f44bac025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c1febed31a412782d17e5ea62d2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:31Z,use_quota=True,user_id='b41cd3b7c7f945e4af853734dcb46d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7934c3-5d45-4172-a05f-5e6959bd6640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7934c3-5d45-4172-a05f-5e6959bd6640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa77af2d-6195-4248-a6c6-8d30e094c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:20:31 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 1G" returned: 0 in 0.544s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:31 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 Aug 17 16:20:31 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa77af2d-6195-4248-a6c6-8d30e094c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9259589-d700-424c-97f1-0f1f44bac025', 'volume_name': 'volume-f9259589-d700-424c-97f1-0f1f44bac025', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c62988-5c49-493e-90c3-7a31041a4ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c62988-5c49-493e-90c3-7a31041a4ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1779e5f4-00dc-4c2e-8232-11d276e32c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Volume f9259589-d700-424c-97f1-0f1f44bac025: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9259589-d700-424c-97f1-0f1f44bac025', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Trying to clone f9259589-d700-424c-97f1-0f1f44bac025 from image 9d40602e-5637-4537-aeab-5c295ac7c705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Acquiring lock "cinder-d97904e4-6e88-434c-8ef5-487756f7aca2-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "cinder-d97904e4-6e88-434c-8ef5-487756f7aca2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Acquiring lock "cinder-quobyte-d97904e4-6e88-434c-8ef5-487756f7aca2" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:31 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "cinder-quobyte-d97904e4-6e88-434c-8ef5-487756f7aca2" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:31 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 is being set with open permissions: ugo+rw Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6436b69b-3721-41a4-affc-afe55d58a883]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:31 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 Aug 17 16:20:31 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:31 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:20:31 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Image download 20.69 MB at 20.69 MB/s Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ababb286-4e72-4e36-b420-b4fad37a7836]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 Aug 17 16:20:32 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD Aug 17 16:20:32 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info Aug 17 16:20:32 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 is fetched for user b41cd3b7c7f945e4af853734dcb46d68. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2" returned: 0 in 0.468s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2 Aug 17 16:20:32 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f0e3b-17db-49ae-8a0d-7448505b3c32]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info" returned: 0 in 0.298s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info is being set with open permissions: ugo+rw Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info Aug 17 16:20:32 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD Aug 17 16:20:32 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:32 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d97904e4-6e88-434c-8ef5-487756f7aca2" returned: 0 in 0.295s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "cinder-quobyte-d97904e4-6e88-434c-8ef5-487756f7aca2" released by "delete_volume" :: held 0.856s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Created reservations ['30f855d5-78bc-401b-a43c-30b889f96ae6', '83b4f00b-6a56-4761-83be-6a196f51cc09', '5478e6b1-a545-448c-b106-dea5619e0179', '322937b3-0405-4937-a186-03258b37a68b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:32 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.info" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.592s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-b7aa33d8-47da-4a86-ace5-8bb8e63d48bf req-e7e346cc-1e2b-474a-bcff-f3a91820a11f tempest-VolumesSnapshotsTestJSON-503439776 None] Create snapshot completed successfully Aug 17 16:20:33 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:20:33 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:33 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1654462021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9259589-d700-424c-97f1-0f1f44bac025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c1febed31a412782d17e5ea62d2ee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:31Z,use_quota=True,user_id='b41cd3b7c7f945e4af853734dcb46d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Creating volume f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:33 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1073741824 Aug 17 16:20:33 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "cinder-5cfff712-f696-4b05-aa29-6fe683458d93-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-5cfff712-f696-4b05-aa29-6fe683458d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "cinder-quobyte-5cfff712-f696-4b05-aa29-6fe683458d93" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:33 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-5cfff712-f696-4b05-aa29-6fe683458d93" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Deleting offline snapshot 5cfff712-f696-4b05-aa29-6fe683458d93 of volume 8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] snapshot_file for this snap is: volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:20:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Deleted volume successfully. Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f980b3e-5682-4843-a0b4-8e639ef2813d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ac4a2fa-f4aa-4211-a74f-8fa878d8076f tempest-VolumeQuotasNegativeTestJSON-1827374934 None] Lock "cinder-d97904e4-6e88-434c-8ef5-487756f7aca2-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:33 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 Aug 17 16:20:33 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:33 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1073741824" returned: 0 in 0.631s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:33 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 Aug 17 16:20:33 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:33 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93" returned: 0 in 0.459s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fcf2c3-b634-459c-ba25-50567dd9c680]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:33 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b Aug 17 16:20:33 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:34 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025" returned: 0 in 0.304s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Attempting download of 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume f9259589-d700-424c-97f1-0f1f44bac025. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5444af-8bf7-48ae-a804-059822d87a05]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:34 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b" returned: 0 in 0.446s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:34 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6 Aug 17 16:20:34 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:34 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 Aug 17 16:20:34 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:34 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6" returned: 0 in 0.469s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:34 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93" returned: 0 in 0.439s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:34 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93 Aug 17 16:20:34 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:34 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6 Aug 17 16:20:34 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:35 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6" returned: 1 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_oycw0sq6' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b17644-7176-4483-a45e-aa91c1e083bd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:35 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b.5cfff712-f696-4b05-aa29-6fe683458d93" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-5cfff712-f696-4b05-aa29-6fe683458d93" released by "_delete_snapshot" :: held 1.857s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" released by "delete_snapshot" :: held 1.916s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:35 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD Aug 17 16:20:35 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:35 devstack cinder-volume[94468]: WARNING cinder.quota [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.quota [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Created reservations ['eb84d1ea-07fa-4b86-bbfc-acbf63345e2f', 'a3079975-1e5d-40eb-87f8-dbed7c4a096a', '784da95e-0f04-4176-a945-8cc6982731f1', '3b39164e-3ae0-4643-8ce9-5885a9a6f851'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Delete snapshot completed successfully. Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-abe5440c-eccf-4501-b41b-0a64cddd3bb0 req-3d2832bf-ac5c-48c0-b0ab-ca844bcf502c tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-5cfff712-f696-4b05-aa29-6fe683458d93-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:35 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] 9d40602e-5637-4537-aeab-5c295ac7c705 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "cinder-8dff5883-7caf-47d6-8a09-8c5915d46d3b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:35 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 Aug 17 16:20:35 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-8dff5883-7caf-47d6-8a09-8c5915d46d3b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e940fe7-3ceb-448e-b198-72e4300e8c73]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:36 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b Aug 17 16:20:36 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:36 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b" returned: 0 in 0.605s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:36 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b Aug 17 16:20:36 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:37 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dff5883-7caf-47d6-8a09-8c5915d46d3b" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-quobyte-8dff5883-7caf-47d6-8a09-8c5915d46d3b" released by "delete_volume" :: held 1.263s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.quota [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Created reservations ['a633ada9-98a1-4e32-afb7-34e00c212857', '8b8f4baa-a2bb-499c-9052-f1a852cce3ee', '108216cf-a068-4a9e-be37-4df756b52905', 'f769a1fa-96b2-442e-837f-94358d99965e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:37 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:20:37 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:37 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.manager [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:20:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Deleted volume successfully. Aug 17 16:20:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4a44209e-6655-4968-af7e-83b02c18870d req-5eef4251-e2e7-455f-a49b-6595ebd01d5d tempest-VolumesSnapshotsTestJSON-503439776 None] Lock "cinder-8dff5883-7caf-47d6-8a09-8c5915d46d3b-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:20:38 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025" returned: 0 in 3.028s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:38 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_a07_68vcdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:20:38 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Converted 112.00 MB image at 36.98 MB/s Aug 17 16:20:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:38 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1G Aug 17 16:20:38 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:39 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 1G" returned: 0 in 0.547s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Downloaded image 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume f9259589-d700-424c-97f1-0f1f44bac025 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 for user b41cd3b7c7f945e4af853734dcb46d68 is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Marking volume f9259589-d700-424c-97f1-0f1f44bac025 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=74,cinder:UPDATE=59,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Copying metadata from image 9d40602e-5637-4537-aeab-5c295ac7c705 to f9259589-d700-424c-97f1-0f1f44bac025. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Creating volume glance metadata for volume f9259589-d700-424c-97f1-0f1f44bac025 backed by image 9d40602e-5637-4537-aeab-5c295ac7c705 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=65,cinder:UPDATE=80,cinder:INSERT=13,cinder:DELETE=5 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1779e5f4-00dc-4c2e-8232-11d276e32c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9259589-d700-424c-97f1-0f1f44bac025', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007da656-c402-428b-9403-fa15e2c9e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Volume volume-f9259589-d700-424c-97f1-0f1f44bac025 (f9259589-d700-424c-97f1-0f1f44bac025): created successfully Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007da656-c402-428b-9403-fa15e2c9e320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Flow 'volume_create_manager' (c7725593-98ec-4a50-bbc6-591b4bcf2bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4c065378-e5f5-489f-a050-bf36a742a0d7 tempest-ServerActionsTestOtherA-726044476 None] Created volume successfully. Aug 17 16:20:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-d9cf47c7-421a-4659-8a6c-fde672c11c06 req-f7b969c1-9e9c-40e6-913e-51bdaef41e70 tempest-AttachVolumeNegativeTest-1332257649 None] Terminate volume connection completed successfully. Aug 17 16:20:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-d9cf47c7-421a-4659-8a6c-fde672c11c06 req-f7b969c1-9e9c-40e6-913e-51bdaef41e70 tempest-AttachVolumeNegativeTest-1332257649 None] Deleting attachment 667ac880-856d-44c5-9161-bc7a73e6512b. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:20:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-1780de6b-bc76-4ff2-8d68-a40ccda45b10 req-57610332-f5b1-48a4-8134-3ac944f2125e tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-1780de6b-bc76-4ff2-8d68-a40ccda45b10 req-57610332-f5b1-48a4-8134-3ac944f2125e tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-1780de6b-bc76-4ff2-8d68-a40ccda45b10 req-57610332-f5b1-48a4-8134-3ac944f2125e tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-1780de6b-bc76-4ff2-8d68-a40ccda45b10 req-57610332-f5b1-48a4-8134-3ac944f2125e tempest-ServerActionsTestOtherA-726044476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-f9259589-d700-424c-97f1-0f1f44bac025', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48f7956c-e121-4df2-b2e3-812592936df1', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:20:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-1780de6b-bc76-4ff2-8d68-a40ccda45b10 req-57610332-f5b1-48a4-8134-3ac944f2125e tempest-ServerActionsTestOtherA-726044476 None] attachment_update completed successfully. Aug 17 16:20:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-668b819e-7800-41d4-afd1-07bdfd805237 tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-1160054783: creating Aug 17 16:20:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-668b819e-7800-41d4-afd1-07bdfd805237 tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-1160054783: created successfully Aug 17 16:20:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-668b819e-7800-41d4-afd1-07bdfd805237 tempest-GroupSnapshotsTest-590850557 None] Create group completed successfully. Aug 17 16:20:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:20:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 28 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:20:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (249ae5a9-0620-48bb-8b48-afde0b340e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed3100-bd09-4f62-9c52-c27c8ef046fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ed3100-bd09-4f62-9c52-c27c8ef046fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1189522633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da28485-ffda-4bd6-a82b-cf733db9a724,host='devstack@QuobyteHD#QuobyteHD',id=7d733742-4f61-441b-bdba-105753334854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:48Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca64cca-725c-486b-b259-6fb5237dae07),volume_type_id=2ca64cca-725c-486b-b259-6fb5237dae07)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f4ffc-442f-4bac-8ca2-055c46069ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0f4ffc-442f-4bac-8ca2-055c46069ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff85970a-ebfd-4e53-a3e1-fa744f7c4ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff85970a-ebfd-4e53-a3e1-fa744f7c4ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d733742-4f61-441b-bdba-105753334854', 'volume_name': 'volume-7d733742-4f61-441b-bdba-105753334854', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389fe825-0819-4038-9509-0bf4bb8f1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389fe825-0819-4038-9509-0bf4bb8f1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff7efc-e944-4d27-b6c4-80786a31e2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Volume 7d733742-4f61-441b-bdba-105753334854: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d733742-4f61-441b-bdba-105753334854', 'volume_size': 1} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7da28485-ffda-4bd6-a82b-cf733db9a724,created_at=2026-08-17T14:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1189522633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da28485-ffda-4bd6-a82b-cf733db9a724,host='devstack@QuobyteHD#QuobyteHD',id=7d733742-4f61-441b-bdba-105753334854,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:20:48Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca64cca-725c-486b-b259-6fb5237dae07),volume_type_id=2ca64cca-725c-486b-b259-6fb5237dae07)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Creating volume 7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:48 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:48 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 1073741824 Aug 17 16:20:48 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:48 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 1073741824" returned: 0 in 0.606s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:49 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:20:49 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:49 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff7efc-e944-4d27-b6c4-80786a31e2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d733742-4f61-441b-bdba-105753334854', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a480c328-6191-4549-a440-0bcd2d3a987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:20:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Volume volume-7d733742-4f61-441b-bdba-105753334854 (7d733742-4f61-441b-bdba-105753334854): created successfully Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a480c328-6191-4549-a440-0bcd2d3a987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:20:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (249ae5a9-0620-48bb-8b48-afde0b340e1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:20:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9227d854-6b5f-43b2-ac9e-744801f7abb0 tempest-GroupSnapshotsTest-590850557 None] Created volume successfully. Aug 17 16:20:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] GroupSnapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: creating. Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Group snapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: creating. {{(pid=94468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Creating offline snapshot c14b4248-59cb-4a67-92f1-ad861925df08 of volume 7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d101a950-8e53-4fd5-93d9-5011a1c6a64c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:51 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:20:51 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:52 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 0.588s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:52 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 1G Aug 17 16:20:52 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:53 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 1G" returned: 0 in 0.760s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d733742-4f61-441b-bdba-105753334854 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:53 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d733742-4f61-441b-bdba-105753334854 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:20:53 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:53 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d733742-4f61-441b-bdba-105753334854 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.455s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:53 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:20:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:53 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:20:53 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:54 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.404s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:54 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info Aug 17 16:20:54 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:54 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info" returned: 0 in 0.640s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:54 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:20:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:54 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info Aug 17 16:20:54 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:55 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.info" returned: 0 in 0.416s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.416s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-663ef57c-244c-4dae-a822-ffeee98eac3e tempest-GroupSnapshotsTest-590850557 None] group_snapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: created successfully Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Creating volume 8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 from snapshot c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] snapshot: c14b4248-59cb-4a67-92f1-ad861925df08, volume: 8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb3fa9-3089-4901-8b89-9d27b9607a5b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:57 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:20:57 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:58 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.559s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d733742-4f61-441b-bdba-105753334854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:20:58 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf0d0d-9e86-4271-8ab6-6523d1c149a9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:20:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:58 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:20:58 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:20:59 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Aug 17 16:20:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 0.838s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:20:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:20:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:20:59 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:20:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:20:59 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 Aug 17 16:20:59 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:07 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:INSERT=3,cinder:SELECT=21,cinder:UPDATE=11 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:21:07 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=31,cinder:INSERT=11,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:21:09 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" returned: 0 in 9.932s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:21:09 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Converted 1024.00 MB image at 103.09 MB/s Aug 17 16:21:09 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:09 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 Aug 17 16:21:09 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:09 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" released by "_copy_volume_from_snapshot" :: held 11.895s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" released by "_create_volume_from_snapshot" :: held 12.056s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.105s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-14484d6a-e86e-441a-8cd2-52824b332120 tempest-GroupSnapshotsTest-590850557 None] Create group from source-snapshot-bd6058e0-b77b-4418-ba5b-65335f6405ae completed successfully. Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113802a-e30d-4f81-b57f-9acc078f9718]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:11 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 Aug 17 16:21:11 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:11 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" returned: 0 in 0.594s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:11 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0 Aug 17 16:21:11 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:12 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" returned: 0 in 0.384s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-8dd4a1a7-ab86-4a2d-b655-0e4d5da86ba0" released by "delete_volume" :: held 1.067s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Created reservations ['8a170727-c912-44b0-8bfc-53cfa29f1db2'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:12 devstack cinder-volume[94468]: WARNING cinder.quota [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1016448027 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1016448027, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:12 devstack cinder-volume[94468]: WARNING cinder.quota [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1016448027 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1016448027, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Created reservations ['cc0dfa8f-8295-4d52-91c9-e66d430ca940', 'f85f9b82-93fc-421d-bbed-ad7841d37cea', 'd0518b2b-67b1-4cb0-b7b6-434c397a1dd6', '9728bb99-1986-4c36-9570-ed0bbb2bce54'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:12 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:21:12 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:12 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.420s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:12 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:21:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2a3791ce-2588-46ae-8f35-fdc2e84c086f tempest-GroupSnapshotsTest-590850557 None] Delete group completed successfully. Aug 17 16:21:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] group_snapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: deleting Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] group_snapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: deleting {{(pid=94468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Deleting offline snapshot c14b4248-59cb-4a67-92f1-ad861925df08 of volume 7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] snapshot_file for this snap is: volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ba6400-312e-49db-ad44-ea4b65a90a73]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:14 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:21:14 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:14 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.690s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d733742-4f61-441b-bdba-105753334854(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:21:14 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5358b-ed49-43ad-97bc-69ce97dd7e66]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:15 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:21:15 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:16 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 1.496s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:16 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:21:16 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:16 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.745s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:17 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08 Aug 17 16:21:17 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:17 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854.c14b4248-59cb-4a67-92f1-ad861925df08" returned: 0 in 0.416s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-c14b4248-59cb-4a67-92f1-ad861925df08" released by "_delete_snapshot" :: held 3.619s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" released by "delete_snapshot" :: held 3.689s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:17 devstack cinder-volume[94468]: WARNING cinder.quota [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1016448027 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1016448027, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:17 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['01fe4324-eee1-4812-9318-f310d40cb4c4', '82dd38d9-4ddc-453a-9ea8-e52727812860', '9bd5b26e-b047-4045-b1ef-ecd699afde59', '60d1943d-6d36-40be-8051-24ef20080bab'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-925310b3-689f-4e6f-9afd-7a8795b9da14 tempest-GroupSnapshotsTest-590850557 None] group_snapshot bd6058e0-b77b-4418-ba5b-65335f6405ae: deleted successfully Aug 17 16:21:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" acquired by "delete_volume" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:19 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3cbea-a3b9-4732-af31-6eeebdafa1f6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:19 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:21:19 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-cfff8c02-72f1-4667-85b9-db91502edddc req-704a9a3a-6f39-4cc6-b4c8-5da0e130c984 tempest-ServerActionsTestOtherA-726044476 None] Terminate volume connection completed successfully. Aug 17 16:21:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-cfff8c02-72f1-4667-85b9-db91502edddc req-704a9a3a-6f39-4cc6-b4c8-5da0e130c984 tempest-ServerActionsTestOtherA-726044476 None] Deleting attachment 48f7956c-e121-4df2-b2e3-812592936df1. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:21:20 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 1.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:20 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854 Aug 17 16:21:20 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:21 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d733742-4f61-441b-bdba-105753334854" returned: 0 in 0.481s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-7d733742-4f61-441b-bdba-105753334854" released by "delete_volume" :: held 1.954s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Created reservations ['e8917a62-c84e-4002-a0b8-d0d02c324332'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:21 devstack cinder-volume[94468]: WARNING cinder.db.api [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1016448027'] Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Created reservations ['c1ac1e8b-2c59-4a8e-8ddb-153153596beb', 'cac4a412-75ad-4168-8d28-5f8dbe2fad1b', '6a2425ef-29bb-4ddb-8296-44e8232603ab', '2137a377-88ab-44ab-b43d-6e33b2ba39d8'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:21 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:21:21 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:21 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:21 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:21:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-da8c7171-5f20-41e9-9d3d-9e610ebc922a tempest-GroupSnapshotsTest-590850557 None] Delete group completed successfully. Aug 17 16:21:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb29f724-5d04-4d20-8426-d0cb69b2d700 tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-1973932048: creating Aug 17 16:21:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb29f724-5d04-4d20-8426-d0cb69b2d700 tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-1973932048: created successfully Aug 17 16:21:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb29f724-5d04-4d20-8426-d0cb69b2d700 tempest-GroupSnapshotsTest-590850557 None] Create group completed successfully. Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-cfff8c02-72f1-4667-85b9-db91502edddc req-0f7c90c0-5303-4d45-acde-1a920b43b40c tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-cfff8c02-72f1-4667-85b9-db91502edddc req-0f7c90c0-5303-4d45-acde-1a920b43b40c tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (e9dff97a-540f-446c-a8bf-b4f233a93874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981adc85-ce34-44ab-9f5d-38d9456c4520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981adc85-ce34-44ab-9f5d-38d9456c4520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257311680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,host='devstack@QuobyteHD#QuobyteHD',id=0a7cc77d-9474-45ee-8024-150c63be7bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:25Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f974665-29bb-4cbc-be8f-b92d1112e26f),volume_type_id=5f974665-29bb-4cbc-be8f-b92d1112e26f)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3f931-598b-43a3-8e8f-64e49f85554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3f931-598b-43a3-8e8f-64e49f85554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b913f2-5669-47d1-a4a4-3ab224b77e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b913f2-5669-47d1-a4a4-3ab224b77e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7cc77d-9474-45ee-8024-150c63be7bb0', 'volume_name': 'volume-0a7cc77d-9474-45ee-8024-150c63be7bb0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3868a912-188c-4f79-89c1-81707f41d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3868a912-188c-4f79-89c1-81707f41d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba024eee-11ab-40d2-a186-d5460b335b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Volume 0a7cc77d-9474-45ee-8024-150c63be7bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7cc77d-9474-45ee-8024-150c63be7bb0', 'volume_size': 1} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-cfff8c02-72f1-4667-85b9-db91502edddc req-0f7c90c0-5303-4d45-acde-1a920b43b40c tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.239s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,created_at=2026-08-17T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-257311680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,host='devstack@QuobyteHD#QuobyteHD',id=0a7cc77d-9474-45ee-8024-150c63be7bb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:25Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f974665-29bb-4cbc-be8f-b92d1112e26f),volume_type_id=5f974665-29bb-4cbc-be8f-b92d1112e26f)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Creating volume 0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:21:25 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:25 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 1073741824 Aug 17 16:21:25 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-cfff8c02-72f1-4667-85b9-db91502edddc req-0f7c90c0-5303-4d45-acde-1a920b43b40c tempest-ServerActionsTestOtherA-726044476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-f9259589-d700-424c-97f1-0f1f44bac025', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1e2d6db-2225-45c4-8176-28976082ddf6', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:21:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-cfff8c02-72f1-4667-85b9-db91502edddc req-0f7c90c0-5303-4d45-acde-1a920b43b40c tempest-ServerActionsTestOtherA-726044476 None] attachment_update completed successfully. Aug 17 16:21:26 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 1073741824" returned: 0 in 0.831s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:26 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 Aug 17 16:21:26 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:27 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0" returned: 0 in 0.809s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba024eee-11ab-40d2-a186-d5460b335b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7cc77d-9474-45ee-8024-150c63be7bb0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d580153a-a3c3-448c-b190-ebb91e52618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Volume volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 (0a7cc77d-9474-45ee-8024-150c63be7bb0): created successfully Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d580153a-a3c3-448c-b190-ebb91e52618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (e9dff97a-540f-446c-a8bf-b4f233a93874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8356be47-1fbb-47af-9bea-37fda17b2541 tempest-GroupSnapshotsTest-590850557 None] Created volume successfully. Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (14122674-1f43-469d-b748-ce090e709167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f982cbc-c0d7-428b-8743-1e448ecf98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f982cbc-c0d7-428b-8743-1e448ecf98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-792156468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,host='devstack@QuobyteHD#QuobyteHD',id=aea6fd58-bdc3-42c5-a959-225e34b05cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:30Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f974665-29bb-4cbc-be8f-b92d1112e26f),volume_type_id=5f974665-29bb-4cbc-be8f-b92d1112e26f)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3b9d50-fd49-4ed3-998a-a970262d0c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d3b9d50-fd49-4ed3-998a-a970262d0c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7841a6c0-591b-4ad7-a709-9108c5429684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7841a6c0-591b-4ad7-a709-9108c5429684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea6fd58-bdc3-42c5-a959-225e34b05cf1', 'volume_name': 'volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4959ef3a-275b-4077-935e-aaf1a762a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4959ef3a-275b-4077-935e-aaf1a762a302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fd7eb7-fdd9-48d0-8ba8-c32394fa1a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Volume aea6fd58-bdc3-42c5-a959-225e34b05cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1', 'volume_size': 1} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,created_at=2026-08-17T14:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-792156468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f85d1a2-6274-4b2e-bc76-5fb989c3d6a9,host='devstack@QuobyteHD#QuobyteHD',id=aea6fd58-bdc3-42c5-a959-225e34b05cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:30Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f974665-29bb-4cbc-be8f-b92d1112e26f),volume_type_id=5f974665-29bb-4cbc-be8f-b92d1112e26f)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Creating volume aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:21:29 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:21:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:29 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 1073741824 Aug 17 16:21:29 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:31 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 1073741824" returned: 0 in 1.140s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:31 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 Aug 17 16:21:31 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:31 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1" returned: 0 in 0.663s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fd7eb7-fdd9-48d0-8ba8-c32394fa1a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef05ab1-b5aa-4715-a9b6-1ec2fd3a5ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Volume volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 (aea6fd58-bdc3-42c5-a959-225e34b05cf1): created successfully Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ef05ab1-b5aa-4715-a9b6-1ec2fd3a5ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (14122674-1f43-469d-b748-ce090e709167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4dbb7b71-5edf-4757-9d1d-55a0067ed3e3 tempest-GroupSnapshotsTest-590850557 None] Created volume successfully. Aug 17 16:21:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ff833963-0d60-4955-9495-40cd45414725 tempest-GroupSnapshotsTest-590850557 None] Update group completed successfully. Aug 17 16:21:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-dff63c2b-4fe2-4a29-859d-ae26643f1b0a tempest-GroupSnapshotsTest-590850557 None] Update group completed successfully. Aug 17 16:21:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0b7bf0fa-607e-4726-a972-b2c18db41898 tempest-GroupSnapshotsTest-590850557 None] Update group completed successfully. Aug 17 16:21:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-79c234f8-1c77-4d54-b4be-eb5a89b7107a tempest-GroupSnapshotsTest-590850557 None] Update group completed successfully. Aug 17 16:21:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] GroupSnapshot 74f812e6-85c3-4705-b780-6c185713fae2: creating. Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Group snapshot 74f812e6-85c3-4705-b780-6c185713fae2: creating. {{(pid=94468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Creating offline snapshot 2cfac91d-8281-4466-a928-d7e47035d2ef of volume 0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa3b8e-9adf-478d-8ec4-451bc81078ed]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:39 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 Aug 17 16:21:39 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:40 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0" returned: 0 in 0.809s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:40 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef 1G Aug 17 16:21:40 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:40 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef 1G" returned: 0 in 0.588s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:40 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef Aug 17 16:21:40 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:40 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:40 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:21:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:41 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef Aug 17 16:21:41 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:41 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef" returned: 0 in 0.317s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:41 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info Aug 17 16:21:41 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:41 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info" returned: 0 in 0.288s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:41 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:21:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:41 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info Aug 17 16:21:41 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:41 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.info" returned: 0 in 0.357s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Creating offline snapshot 515a42b8-9f35-42f4-bea4-88a31e6c1ae6 of volume aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55996b-0220-4bad-a808-6f0a509af487]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:42 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 Aug 17 16:21:42 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (af76e041-4246-4254-80d7-76066ca371bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51f387e-0de7-4c84-bad8-ef2ce3ad9f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a51f387e-0de7-4c84-bad8-ef2ce3ad9f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978540862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839aaa12-4c7a-44af-b486-326c4aeaf255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:43Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c97cc-af06-473f-8158-17d670582040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307c97cc-af06-473f-8158-17d670582040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848045a5-0a02-4159-b6de-18e8b5bb6b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (848045a5-0a02-4159-b6de-18e8b5bb6b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839aaa12-4c7a-44af-b486-326c4aeaf255', 'volume_name': 'volume-839aaa12-4c7a-44af-b486-326c4aeaf255', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ebd528-e266-450f-996a-c2e611efcb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ebd528-e266-450f-996a-c2e611efcb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf5770e-3a88-4321-8a56-1511db9a31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Volume 839aaa12-4c7a-44af-b486-326c4aeaf255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839aaa12-4c7a-44af-b486-326c4aeaf255', 'volume_size': 1} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:42 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1" returned: 0 in 0.740s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:42 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 1G Aug 17 16:21:42 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:43 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 1G" returned: 0 in 0.651s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:43 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 Aug 17 16:21:43 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:43 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6" returned: 0 in 0.494s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:43 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:21:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:44 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 Aug 17 16:21:44 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:44 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:44 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info Aug 17 16:21:44 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:44 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info" returned: 0 in 0.436s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:44 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:21:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:44 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info Aug 17 16:21:44 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:45 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.info" returned: 0 in 0.353s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.543s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1978540862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839aaa12-4c7a-44af-b486-326c4aeaf255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:43Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Creating volume 839aaa12-4c7a-44af-b486-326c4aeaf255 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:21:45 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:45 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 1073741824 Aug 17 16:21:45 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-91ba914f-c5e3-48d8-b888-1d51363b17cf tempest-GroupSnapshotsTest-590850557 None] group_snapshot 74f812e6-85c3-4705-b780-6c185713fae2: created successfully Aug 17 16:21:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] group_snapshot 74f812e6-85c3-4705-b780-6c185713fae2: deleting Aug 17 16:21:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] group_snapshot 74f812e6-85c3-4705-b780-6c185713fae2: deleting {{(pid=94468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:46 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 1073741824" returned: 0 in 0.742s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" acquired by "delete_snapshot" :: waited 0.056s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-2cfac91d-8281-4466-a928-d7e47035d2ef" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2cfac91d-8281-4466-a928-d7e47035d2ef" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Deleting offline snapshot 2cfac91d-8281-4466-a928-d7e47035d2ef of volume 0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:21:46 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 Aug 17 16:21:46 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] snapshot_file for this snap is: volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2a4e91-c598-45c1-bb37-1d2069c4199c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:46 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef Aug 17 16:21:46 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:46 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255" returned: 0 in 0.521s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf5770e-3a88-4321-8a56-1511db9a31c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839aaa12-4c7a-44af-b486-326c4aeaf255', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd06f14-ec79-45c4-aa28-6b47662a09dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:46 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:21:46 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:46 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Volume volume-839aaa12-4c7a-44af-b486-326c4aeaf255 (839aaa12-4c7a-44af-b486-326c4aeaf255): created successfully Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd06f14-ec79-45c4-aa28-6b47662a09dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (af76e041-4246-4254-80d7-76066ca371bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4e0e6cbd-b866-4e6f-a765-8f510fc507a2 tempest-AttachVolumeNegativeTest-1332257649 None] Created volume successfully. Aug 17 16:21:46 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef" returned: 0 in 0.718s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a7cc77d-9474-45ee-8024-150c63be7bb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c587b399-1390-4c2f-a65d-9e04bc861fb0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:47 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.465s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 28 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:21:47 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 Aug 17 16:21:47 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:47 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0" returned: 0 in 0.646s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:47 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef Aug 17 16:21:47 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-230c36e1-3fca-4a24-ac84-92fdd2b3353f req-f7cb12f1-79eb-40a7-b36f-033b7e8b4838 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-230c36e1-3fca-4a24-ac84-92fdd2b3353f req-f7cb12f1-79eb-40a7-b36f-033b7e8b4838 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-230c36e1-3fca-4a24-ac84-92fdd2b3353f req-f7cb12f1-79eb-40a7-b36f-033b7e8b4838 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-230c36e1-3fca-4a24-ac84-92fdd2b3353f req-f7cb12f1-79eb-40a7-b36f-033b7e8b4838 tempest-AttachVolumeNegativeTest-1332257649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-839aaa12-4c7a-44af-b486-326c4aeaf255', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa25489e-3b78-4770-a543-6057d644ea10', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:21:48 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef" returned: 0 in 0.570s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:48 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef Aug 17 16:21:48 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-230c36e1-3fca-4a24-ac84-92fdd2b3353f req-f7cb12f1-79eb-40a7-b36f-033b7e8b4838 tempest-AttachVolumeNegativeTest-1332257649 None] attachment_update completed successfully. Aug 17 16:21:48 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0.2cfac91d-8281-4466-a928-d7e47035d2ef" returned: 0 in 0.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2cfac91d-8281-4466-a928-d7e47035d2ef" released by "_delete_snapshot" :: held 2.454s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" released by "delete_snapshot" :: held 2.530s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-515a42b8-9f35-42f4-bea4-88a31e6c1ae6" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-515a42b8-9f35-42f4-bea4-88a31e6c1ae6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Deleting offline snapshot 515a42b8-9f35-42f4-bea4-88a31e6c1ae6 of volume aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] snapshot_file for this snap is: volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b1d55-c8ef-4b63-b217-9f5f4f9a75e4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:48 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 Aug 17 16:21:48 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:49 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6" returned: 0 in 0.604s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146cacc-7802-42d0-b9a2-da29bde6ab78]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:49 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 Aug 17 16:21:49 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:49 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1" returned: 0 in 0.451s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:49 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 Aug 17 16:21:49 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:50 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6" returned: 0 in 0.384s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:50 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6 Aug 17 16:21:50 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:50 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1.515a42b8-9f35-42f4-bea4-88a31e6c1ae6" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-515a42b8-9f35-42f4-bea4-88a31e6c1ae6" released by "_delete_snapshot" :: held 1.918s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" released by "delete_snapshot" :: held 1.951s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:50 devstack cinder-volume[94468]: WARNING cinder.quota [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1881806883 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1881806883, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:50 devstack cinder-volume[94468]: WARNING cinder.quota [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1881806883 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1881806883, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Created reservations ['83a1872d-9d9f-4807-aeb6-9c523feda466', 'e7f0fbe6-1372-4763-9ded-4d6cda705341', 'e73cf37e-80ed-4e42-8092-5a350edf435d', '0abea942-c479-4a38-9f84-7ee091bab742'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] Created reservations ['e07b552e-ae73-466e-b459-0472b8d303dc', 'dff2f2d9-63be-42e3-9b7d-eaadc10729f3', '1447d28c-cb47-4dd2-a247-3f5338c157b1', 'b84c53a7-829f-431d-a61d-0a7de87ed869'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f9fdbded-e668-483c-8605-1495e0e45ffe tempest-GroupSnapshotsTest-590850557 None] group_snapshot 74f812e6-85c3-4705-b780-6c185713fae2: deleted successfully Aug 17 16:21:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-d4327128-7fb5-4646-88fc-880cd5caef8a req-ce56ccbd-c8b3-41ad-8643-73212887f6e6 tempest-AttachVolumeNegativeTest-1332257649 None] Terminate volume connection completed successfully. Aug 17 16:21:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-d4327128-7fb5-4646-88fc-880cd5caef8a req-ce56ccbd-c8b3-41ad-8643-73212887f6e6 tempest-AttachVolumeNegativeTest-1332257649 None] Deleting attachment aa25489e-3b78-4770-a543-6057d644ea10. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:21:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6942ce-d40b-45b5-96b7-981c2f057309]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:52 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 Aug 17 16:21:52 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:53 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0" returned: 0 in 0.744s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:53 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0 Aug 17 16:21:53 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:53 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0a7cc77d-9474-45ee-8024-150c63be7bb0" returned: 0 in 0.385s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-0a7cc77d-9474-45ee-8024-150c63be7bb0" released by "delete_volume" :: held 1.254s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[888f2aba-4df8-4850-9b13-a9a0d138a2eb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:21:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:54 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 Aug 17 16:21:54 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:54 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1" returned: 0 in 0.627s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:54 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1 Aug 17 16:21:54 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:54 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-aea6fd58-bdc3-42c5-a959-225e34b05cf1" returned: 0 in 0.305s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-aea6fd58-bdc3-42c5-a959-225e34b05cf1" released by "delete_volume" :: held 1.084s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['9a596ad1-d38c-4558-ab6d-5f16d70cd61b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:54 devstack cinder-volume[94468]: WARNING cinder.quota [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1881806883 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1881806883, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:21:54 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['8b6e68f5-3699-4ff7-828b-a5d7097bd10d', '2f278e82-4a97-44f6-966c-1b7fb9de5fa4', '90bacf9d-52ba-4448-bff0-d0489ecbeeb8', 'b992e28e-f28a-45fc-9739-76ffa99e97df'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['ae950f29-91ec-49ac-86d1-c5fcdac25cf4', '2572964e-0862-4ac5-9a95-e6e562b75920', '348905c2-2f06-4bc0-b89a-76245137647f', '85d76ceb-ee5f-4be7-b8de-dca90a279d5e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:55 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:21:55 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:21:55 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:21:55 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:21:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-192d0e82-2530-4b65-893d-790e44335764 tempest-GroupSnapshotsTest-590850557 None] Delete group completed successfully. Aug 17 16:21:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8719b887-c79a-4526-8d51-2019be51f28d tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-772673811: creating Aug 17 16:21:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8719b887-c79a-4526-8d51-2019be51f28d tempest-GroupSnapshotsTest-590850557 None] Group tempest-GroupSnapshotsTest-Group-772673811: created successfully Aug 17 16:21:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8719b887-c79a-4526-8d51-2019be51f28d tempest-GroupSnapshotsTest-590850557 None] Create group completed successfully. Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (947a6d1b-2239-4247-ae6c-126b91f20534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b312b0d-937e-44ab-83e2-18259061e3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b312b0d-937e-44ab-83e2-18259061e3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676483050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da04c0cc-f2cb-43e5-80bc-61a2ab914b48,host='devstack@QuobyteHD#QuobyteHD',id=2fb5e484-ee0d-4981-805b-0f9e0b5f6024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:59Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e0f7b78-5508-4b04-aaa4-3a7d05287729),volume_type_id=9e0f7b78-5508-4b04-aaa4-3a7d05287729)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d8103d-cae9-4452-860c-fd91f2a6f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d8103d-cae9-4452-860c-fd91f2a6f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65806a72-d027-4692-97f1-72feab4c9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65806a72-d027-4692-97f1-72feab4c9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb5e484-ee0d-4981-805b-0f9e0b5f6024', 'volume_name': 'volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca8c59f-7e3d-477a-aca4-ba951d9a63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ca8c59f-7e3d-477a-aca4-ba951d9a63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049522a0-676c-4857-8f35-8d5c303e4976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:21:59 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Volume 2fb5e484-ee0d-4981-805b-0f9e0b5f6024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024', 'volume_size': 1} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da04c0cc-f2cb-43e5-80bc-61a2ab914b48,created_at=2026-08-17T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676483050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da04c0cc-f2cb-43e5-80bc-61a2ab914b48,host='devstack@QuobyteHD#QuobyteHD',id=2fb5e484-ee0d-4981-805b-0f9e0b5f6024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e41a8e0b99554994a1fe312b9d5b1635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:21:59Z,use_quota=True,user_id='f955d77d3fe344129567be499d3c3c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e0f7b78-5508-4b04-aaa4-3a7d05287729),volume_type_id=9e0f7b78-5508-4b04-aaa4-3a7d05287729)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Creating volume 2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:21:59 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:21:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:21:59 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 1073741824 Aug 17 16:21:59 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:00 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 1073741824" returned: 0 in 0.940s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:00 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 Aug 17 16:22:00 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:01 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" returned: 0 in 0.837s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (049522a0-676c-4857-8f35-8d5c303e4976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de3e9e5-6cee-407b-bca4-c7b690ebd6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:01 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Volume volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 (2fb5e484-ee0d-4981-805b-0f9e0b5f6024): created successfully Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de3e9e5-6cee-407b-bca4-c7b690ebd6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Flow 'volume_create_manager' (947a6d1b-2239-4247-ae6c-126b91f20534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9e7b504f-b789-4b23-88c2-85541caa9678 tempest-GroupSnapshotsTest-590850557 None] Created volume successfully. Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (f80f1e4d-9037-465d-9001-9b35754977d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6e2b8e-517e-4c25-ace1-84a3fd8938db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] GroupSnapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: creating. Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6e2b8e-517e-4c25-ace1-84a3fd8938db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996206202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71e927d-95b3-4610-9a9d-ba382217f2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:03Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1d9067-c7ce-401c-9cad-917cc2ed8eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1d9067-c7ce-401c-9cad-917cc2ed8eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7ee199-6cc1-4a2c-8028-487a9017cb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa7ee199-6cc1-4a2c-8028-487a9017cb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71e927d-95b3-4610-9a9d-ba382217f2bc', 'volume_name': 'volume-e71e927d-95b3-4610-9a9d-ba382217f2bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d310298-dec5-46c1-95d0-30d9f5c71ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d310298-dec5-46c1-95d0-30d9f5c71ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf30644f-60aa-4028-9a0c-9af836eb9cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Volume e71e927d-95b3-4610-9a9d-ba382217f2bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71e927d-95b3-4610-9a9d-ba382217f2bc', 'volume_size': 1} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-996206202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71e927d-95b3-4610-9a9d-ba382217f2bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:03Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Creating volume e71e927d-95b3-4610-9a9d-ba382217f2bc {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:03 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Group snapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: creating. {{(pid=94468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 16:22:03 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc 1073741824 Aug 17 16:22:03 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-8079c334-350b-4e70-a715-7ba7287959d6 tempest-ServerActionsTestOtherA-726044476 None] Terminate volume connection completed successfully. Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-8079c334-350b-4e70-a715-7ba7287959d6 tempest-ServerActionsTestOtherA-726044476 None] Deleting attachment e1e2d6db-2225-45c4-8176-28976082ddf6. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:22:04 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc 1073741824" returned: 0 in 0.830s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:04 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc Aug 17 16:22:04 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "cinder-f9259589-d700-424c-97f1-0f1f44bac025-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-f9259589-d700-424c-97f1-0f1f44bac025-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "cinder-quobyte-f9259589-d700-424c-97f1-0f1f44bac025" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-quobyte-f9259589-d700-424c-97f1-0f1f44bac025" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4d0c0-ae6f-4947-9357-2bb9b87c87a4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:04 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.218s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf30644f-60aa-4028-9a0c-9af836eb9cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71e927d-95b3-4610-9a9d-ba382217f2bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb7ff60-8af8-47a4-83bd-7a00f21aae20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Creating offline snapshot 28563e0c-1c90-464f-b6c9-9640da48ab5c of volume 2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:22:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Volume volume-e71e927d-95b3-4610-9a9d-ba382217f2bc (e71e927d-95b3-4610-9a9d-ba382217f2bc): created successfully Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb7ff60-8af8-47a4-83bd-7a00f21aae20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (f80f1e4d-9037-465d-9001-9b35754977d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c14b34-1143-427b-b52b-7ceee246304f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:04 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 Aug 17 16:22:04 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-71e3453d-9140-461b-a1cc-3cacab0fbf67 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:04 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 Aug 17 16:22:04 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:05 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-70833a95-69d3-4525-9fe0-3c81d5d33318 tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc" by "attach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025" returned: 0 in 0.846s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-70833a95-69d3-4525-9fe0-3c81d5d33318 tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc" acquired by "attach_volume" :: waited 0.062s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:05 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025 Aug 17 16:22:05 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-70833a95-69d3-4525-9fe0-3c81d5d33318 tempest-VolumesActionsTest-195493845 None] Attaching volume e71e927d-95b3-4610-9a9d-ba382217f2bc to instance a03a8809-99ad-4570-b86b-64ab863a17cd at mountpoint /dev/vdb on host None. Aug 17 16:22:05 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" returned: 0 in 0.875s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-70833a95-69d3-4525-9fe0-3c81d5d33318 tempest-VolumesActionsTest-195493845 None] Attach volume completed successfully. Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-70833a95-69d3-4525-9fe0-3c81d5d33318 tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc" released by "attach_volume" :: held 0.219s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:05 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c 1G Aug 17 16:22:05 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:05 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9259589-d700-424c-97f1-0f1f44bac025" returned: 0 in 0.446s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-quobyte-f9259589-d700-424c-97f1-0f1f44bac025" released by "delete_volume" :: held 1.381s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:05 devstack cinder-volume[94468]: DEBUG cinder.quota [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Created reservations ['17b50053-5634-4cdd-930f-ccffe0439958', '823fbb4d-d47c-4eeb-9244-d0bd89120c3d', 'e2ad797d-93d7-4bd5-9081-aa7d226ad87a', '4a20c196-4c4a-47cf-b7bd-9eac495ee343'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:06 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:06 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:06 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c 1G" returned: 0 in 0.795s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:06 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c Aug 17 16:22:06 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:06 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.528s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG cinder.manager [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Deleted volume successfully. Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-0b9b08f1-9520-4cc5-8a6c-3767fd55ac21 req-e25a1ad2-0418-4798-9ad3-4571c106c36f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-f9259589-d700-424c-97f1-0f1f44bac025-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Terminate volume connection completed successfully. Aug 17 16:22:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" by "detach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:07 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c" returned: 0 in 0.687s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:07 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "cinder-600d8d92-6b88-49c0-a030-6d9375c38925-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Detaching volume e71e927d-95b3-4610-9a9d-ba382217f2bc from instance a03a8809-99ad-4570-b86b-64ab863a17cd. Aug 17 16:22:07 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-600d8d92-6b88-49c0-a030-6d9375c38925-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:07 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "cinder-quobyte-600d8d92-6b88-49c0-a030-6d9375c38925" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Detach volume completed successfully. Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-quobyte-600d8d92-6b88-49c0-a030-6d9375c38925" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bfd50611-673e-4609-aefb-d055eddbd496 tempest-VolumesActionsTest-328606280 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f66a16-f668-4fe9-9391-d1c5f401c8ad]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:07 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 Aug 17 16:22:07 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80bed2f5-168e-44a6-9352-4ded6c085e09 tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" by "detach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80bed2f5-168e-44a6-9352-4ded6c085e09 tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-80bed2f5-168e-44a6-9352-4ded6c085e09 tempest-VolumesActionsTest-195493845 None] Volume detach called, but volume not attached. Aug 17 16:22:07 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c" returned: 0 in 0.614s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=96,cinder:INSERT=20,cinder:SELECT=113,cinder:DELETE=3 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80bed2f5-168e-44a6-9352-4ded6c085e09 tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:07 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info Aug 17 16:22:07 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:07 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925" returned: 0 in 0.714s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:08 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925 Aug 17 16:22:08 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=114,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=3 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-quobyte-e71e927d-95b3-4610-9a9d-ba382217f2bc" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:08 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info" returned: 0 in 0.744s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:08 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "cinder-quobyte-e71e927d-95b3-4610-9a9d-ba382217f2bc" acquired by "delete_volume" :: waited 0.073s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:08 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info Aug 17 16:22:08 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b7e6c-e51f-4b69-9f13-6037222ceefc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:08 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-600d8d92-6b88-49c0-a030-6d9375c38925" returned: 0 in 0.609s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-quobyte-600d8d92-6b88-49c0-a030-6d9375c38925" released by "delete_volume" :: held 1.408s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Created reservations ['8180bb85-c1dd-4326-ab5a-875833062def', 'ea5d9685-0acc-4904-8d04-a4c3e84c142f', '090527f2-2149-4176-9ad8-2269f7b86ebd', 'f9c587cb-3a77-4764-9eac-2be133ab7b2c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:08 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc Aug 17 16:22:08 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:08 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.info" returned: 0 in 0.468s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:08 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:08 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f3659f0a-4497-4753-8e2c-e0196e4d1c9d tempest-GroupSnapshotsTest-590850557 None] group_snapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: created successfully Aug 17 16:22:09 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc" returned: 0 in 0.781s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:09 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc Aug 17 16:22:09 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:09 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.522s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Deleted volume successfully. Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b385272-0aa0-44da-bbad-286772f6098f tempest-ServerActionsTestOtherA-726044476 None] Lock "cinder-600d8d92-6b88-49c0-a030-6d9375c38925-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:09 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e71e927d-95b3-4610-9a9d-ba382217f2bc" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "cinder-quobyte-e71e927d-95b3-4610-9a9d-ba382217f2bc" released by "delete_volume" :: held 1.256s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Created reservations ['0270ea18-ce06-4e6d-8469-14d011a1e0a2', '7aaff92c-4e92-4b78-ba43-9cfe9a62de1c', '9a8059e4-c4b7-4891-8189-98b12fe342fe', 'ca0e1d42-6df1-41c8-aa7b-61c09b046e20'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:10 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:10 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] group_snapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: deleting Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] group_snapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: deleting {{(pid=94468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" acquired by "delete_snapshot" :: waited 0.060s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-28563e0c-1c90-464f-b6c9-9640da48ab5c" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-28563e0c-1c90-464f-b6c9-9640da48ab5c" acquired by "_delete_snapshot" :: waited 0.074s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Deleting offline snapshot 28563e0c-1c90-464f-b6c9-9640da48ab5c of volume 2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:22:10 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] snapshot_file for this snap is: volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.754s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:10 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[43df2e88-3629-4176-8d2a-7569802e1b79]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Deleted volume successfully. Aug 17 16:22:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9cde5269-c644-4d45-990c-8c34758b3e4d tempest-VolumesActionsTest-195493845 None] Lock "cinder-e71e927d-95b3-4610-9a9d-ba382217f2bc-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:11 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c Aug 17 16:22:11 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:12 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c" returned: 0 in 0.950s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a157fab7-5949-4efe-a41d-77eafffe1bf9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:12 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 Aug 17 16:22:12 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:12 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" returned: 0 in 0.712s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:12 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c Aug 17 16:22:12 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:13 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c" returned: 0 in 0.599s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:13 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c Aug 17 16:22:13 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:13 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024.28563e0c-1c90-464f-b6c9-9640da48ab5c" returned: 0 in 0.369s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-28563e0c-1c90-464f-b6c9-9640da48ab5c" released by "_delete_snapshot" :: held 3.051s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" released by "delete_snapshot" :: held 3.157s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:13 devstack cinder-volume[94468]: WARNING cinder.quota [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-202987136 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-202987136, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:22:13 devstack cinder-volume[94468]: WARNING cinder.quota [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-202987136 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-202987136, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:22:14 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['9c3d0929-76a5-4481-ac73-f8efe9033531', 'b5f53c95-09a1-43de-9fd3-44ce4d2b7626', '9a48959f-56d6-47b1-9c3f-33a6e6cd21b2', 'c7ed13de-1cc7-45c8-a64f-59fdcf441cab'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d978f4a7-e23a-43a1-bf3e-4bd3ee5052d4 tempest-GroupSnapshotsTest-590850557 None] group_snapshot 1fa6ffc5-1aa0-47bf-873a-784e51fb3000: deleted successfully Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce60314-1f7a-438d-bfe1-c95602698c4d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:15 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 Aug 17 16:22:15 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:15 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" returned: 0 in 0.507s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:15 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024 Aug 17 16:22:15 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:16 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" returned: 0 in 0.468s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Lock "cinder-quobyte-2fb5e484-ee0d-4981-805b-0f9e0b5f6024" released by "delete_volume" :: held 1.111s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['d4b674d6-fcbf-48a2-be89-0baf387a47f6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:16 devstack cinder-volume[94468]: WARNING cinder.quota [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-202987136 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-202987136, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Created reservations ['022f0c00-85d3-41e7-af3a-2172c78a500e', 'd3e6c412-bb97-4e36-8a5b-d192c03b100d', '0751ab2f-cec4-4ef4-bbeb-6d86a2f8d826', '2e8a8d17-3051-45eb-8654-c1452468de91'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:16 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:16 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (b7c70507-774a-4902-8270-132f35b396b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad594c2d-4697-4d17-be2c-28e305131b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad594c2d-4697-4d17-be2c-28e305131b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122001023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e994efaa-7927-4d5e-bf46-091bb09dae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:17Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8dbbc9-bb16-427a-9741-bfa8554ba26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8dbbc9-bb16-427a-9741-bfa8554ba26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfaa616-ae94-4b82-a99a-c28ef994df4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfaa616-ae94-4b82-a99a-c28ef994df4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e994efaa-7927-4d5e-bf46-091bb09dae33', 'volume_name': 'volume-e994efaa-7927-4d5e-bf46-091bb09dae33', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766390f2-d4ee-442d-bf24-d5a4a452a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766390f2-d4ee-442d-bf24-d5a4a452a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16aa933-4bac-481c-865c-776feb586f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:17 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Volume e994efaa-7927-4d5e-bf46-091bb09dae33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e994efaa-7927-4d5e-bf46-091bb09dae33', 'volume_size': 1} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1122001023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e994efaa-7927-4d5e-bf46-091bb09dae33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:17Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Creating volume e994efaa-7927-4d5e-bf46-091bb09dae33 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:17 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:17 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 1073741824 Aug 17 16:22:17 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:17 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.724s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:17 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-cfdabab4-17b6-4ef5-85b8-14424b5f0ad7 tempest-GroupSnapshotsTest-590850557 None] Delete group completed successfully. Aug 17 16:22:18 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 1073741824" returned: 0 in 1.075s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:18 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 Aug 17 16:22:18 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:18 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33" returned: 0 in 0.619s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16aa933-4bac-481c-865c-776feb586f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e994efaa-7927-4d5e-bf46-091bb09dae33', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f590138-4916-4415-b468-9937695a411d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:18 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Volume volume-e994efaa-7927-4d5e-bf46-091bb09dae33 (e994efaa-7927-4d5e-bf46-091bb09dae33): created successfully Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f590138-4916-4415-b468-9937695a411d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (b7c70507-774a-4902-8270-132f35b396b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0d147a4d-a429-41f5-b797-c7dacb4bc7d1 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-e994efaa-7927-4d5e-bf46-091bb09dae33-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "cinder-e994efaa-7927-4d5e-bf46-091bb09dae33-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-quobyte-e994efaa-7927-4d5e-bf46-091bb09dae33" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-e994efaa-7927-4d5e-bf46-091bb09dae33" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04661fb-c524-4972-8725-9b858c7bf012]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:20 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 Aug 17 16:22:20 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:21 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33" returned: 0 in 0.680s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:21 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33 Aug 17 16:22:21 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:21 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e994efaa-7927-4d5e-bf46-091bb09dae33" returned: 0 in 0.443s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-e994efaa-7927-4d5e-bf46-091bb09dae33" released by "delete_volume" :: held 1.232s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Created reservations ['632e128f-391f-4f97-b278-edbbe2df57d4', '794f374a-32a0-49f8-b888-7a4e2c681076', 'f122203e-82cc-47a1-ac18-35e5d508561e', '4102289a-6539-424e-b44a-3e6da846a30c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:21 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:21 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:22 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.479s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:22 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Deleted volume successfully. Aug 17 16:22:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350ca2a0-75f2-4ebb-87d6-95eae7318271 tempest-VolumesActionsTest-328606280 None] Lock "cinder-e994efaa-7927-4d5e-bf46-091bb09dae33-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (72ee1379-c140-4442-aeb8-95b5147048bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe588ed-a2c6-4060-9274-a275cca6d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe588ed-a2c6-4060-9274-a275cca6d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875278243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db9e73-796a-4d5d-89a8-2e6272d2ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:23Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a5f55b-1777-4cbb-8c58-0bd2f0fe94f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a5f55b-1777-4cbb-8c58-0bd2f0fe94f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae22c57-0132-4c3d-91bb-9d924b79cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae22c57-0132-4c3d-91bb-9d924b79cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17db9e73-796a-4d5d-89a8-2e6272d2ac11', 'volume_name': 'volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059731f-e5fa-4cbd-8033-23c53a24fd80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059731f-e5fa-4cbd-8033-23c53a24fd80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305aea8-13c8-40a0-9c78-b1c4d104c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Volume 17db9e73-796a-4d5d-89a8-2e6272d2ac11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11', 'volume_size': 1} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1875278243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db9e73-796a-4d5d-89a8-2e6272d2ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:23Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Creating volume 17db9e73-796a-4d5d-89a8-2e6272d2ac11 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:23 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:23 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 1073741824 Aug 17 16:22:23 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:24 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 1073741824" returned: 0 in 1.072s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:24 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 Aug 17 16:22:24 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:25 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3305aea8-13c8-40a0-9c78-b1c4d104c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4cf83d-c540-49e5-b4a2-266325d480ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Volume volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 (17db9e73-796a-4d5d-89a8-2e6272d2ac11): created successfully Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4cf83d-c540-49e5-b4a2-266325d480ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (72ee1379-c140-4442-aeb8-95b5147048bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2f05a860-d775-45b9-97fb-687623dc0164 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-17db9e73-796a-4d5d-89a8-2e6272d2ac11-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "cinder-17db9e73-796a-4d5d-89a8-2e6272d2ac11-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-quobyte-17db9e73-796a-4d5d-89a8-2e6272d2ac11" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-17db9e73-796a-4d5d-89a8-2e6272d2ac11" acquired by "delete_volume" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55ef880-6018-4534-ad8f-62f8d1b78386]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:27 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 Aug 17 16:22:27 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:27 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11" returned: 0 in 0.521s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:27 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11 Aug 17 16:22:27 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:28 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17db9e73-796a-4d5d-89a8-2e6272d2ac11" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-17db9e73-796a-4d5d-89a8-2e6272d2ac11" released by "delete_volume" :: held 0.951s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Created reservations ['ca21509a-1de8-4827-bb95-640701227d88', '38f2e191-2930-4cae-9ab3-8d04ba298cea', '9883ca56-1570-4aff-a11d-a41d8454245f', 'f1a8549b-ff9a-410c-99ca-09c67e742100'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2730cb87-8052-4a6b-8555-874063510ede tempest-GroupsV314Test-1857000353 None] Group tempest-GroupsV314Test-Group-105758410: creating Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2730cb87-8052-4a6b-8555-874063510ede tempest-GroupsV314Test-1857000353 None] Group tempest-GroupsV314Test-Group-105758410: created successfully Aug 17 16:22:28 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:28 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2730cb87-8052-4a6b-8555-874063510ede tempest-GroupsV314Test-1857000353 None] Create group completed successfully. Aug 17 16:22:28 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.360s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Deleted volume successfully. Aug 17 16:22:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6159fb09-2db2-4a87-a929-6a4ca98f6b16 tempest-VolumesActionsTest-328606280 None] Lock "cinder-17db9e73-796a-4d5d-89a8-2e6272d2ac11-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (091b0e63-066b-4ff2-a1e9-e741e2f058ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cecab1d-7dbc-4a92-8acf-7bb083f00960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cecab1d-7dbc-4a92-8acf-7bb083f00960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27714012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650bed0-5f41-49b3-9e94-6b11e36f833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:30Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c320d7-41ec-4e70-b79e-1fb809dac1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c320d7-41ec-4e70-b79e-1fb809dac1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ef43d-f98e-4215-a929-1fbe4ec73b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ef43d-f98e-4215-a929-1fbe4ec73b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9650bed0-5f41-49b3-9e94-6b11e36f833a', 'volume_name': 'volume-9650bed0-5f41-49b3-9e94-6b11e36f833a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd79873a-62ae-487b-bd71-1ad9ffe96f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd79873a-62ae-487b-bd71-1ad9ffe96f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231787fd-cc56-492f-b800-62e018e8da23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Volume 9650bed0-5f41-49b3-9e94-6b11e36f833a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9650bed0-5f41-49b3-9e94-6b11e36f833a', 'volume_size': 1} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-27714012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9650bed0-5f41-49b3-9e94-6b11e36f833a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:30Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Creating volume 9650bed0-5f41-49b3-9e94-6b11e36f833a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:30 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:30 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a 1073741824 Aug 17 16:22:30 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Flow 'volume_create_manager' (66ac2299-608a-421f-b087-41a7f05c9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6761645-ce21-42b0-9b6e-983a42158ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6761645-ce21-42b0-9b6e-983a42158ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750236223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56d5d765-0de6-4f4f-92e6-33fe15e112ca,host='devstack@QuobyteHD#QuobyteHD',id=7b304131-7115-4e86-90a1-f46968543b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36d2443157c4862ae06287496c781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:31Z,use_quota=True,user_id='85fe31c7e0074d6b98336bc47499ec72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4184c39-7a5b-4b14-b1fb-cf1e8f7bf314),volume_type_id=b4184c39-7a5b-4b14-b1fb-cf1e8f7bf314)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff0a62-a41b-4c1a-a69c-0e9d75817ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff0a62-a41b-4c1a-a69c-0e9d75817ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9d3ac2-fad4-49c9-8e36-1f66af26ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9d3ac2-fad4-49c9-8e36-1f66af26ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b304131-7115-4e86-90a1-f46968543b5a', 'volume_name': 'volume-7b304131-7115-4e86-90a1-f46968543b5a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49787575-ab16-4218-8056-190a24d86b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49787575-ab16-4218-8056-190a24d86b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc879c0-f1b3-47e3-92f4-9eec9f4fa922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Volume 7b304131-7115-4e86-90a1-f46968543b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b304131-7115-4e86-90a1-f46968543b5a', 'volume_size': 1} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:31 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a 1073741824" returned: 0 in 0.914s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:31 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a Aug 17 16:22:31 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:32 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56d5d765-0de6-4f4f-92e6-33fe15e112ca,created_at=2026-08-17T14:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-750236223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56d5d765-0de6-4f4f-92e6-33fe15e112ca,host='devstack@QuobyteHD#QuobyteHD',id=7b304131-7115-4e86-90a1-f46968543b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36d2443157c4862ae06287496c781f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:31Z,use_quota=True,user_id='85fe31c7e0074d6b98336bc47499ec72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4184c39-7a5b-4b14-b1fb-cf1e8f7bf314),volume_type_id=b4184c39-7a5b-4b14-b1fb-cf1e8f7bf314)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Creating volume 7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:32 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:32 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a 1073741824 Aug 17 16:22:32 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231787fd-cc56-492f-b800-62e018e8da23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9650bed0-5f41-49b3-9e94-6b11e36f833a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ff56bb-91ae-4402-90b2-778b454a29ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Volume volume-9650bed0-5f41-49b3-9e94-6b11e36f833a (9650bed0-5f41-49b3-9e94-6b11e36f833a): created successfully Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ff56bb-91ae-4402-90b2-778b454a29ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (091b0e63-066b-4ff2-a1e9-e741e2f058ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e5653168-5dbb-4029-892f-a143dc78cf06 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-9650bed0-5f41-49b3-9e94-6b11e36f833a-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "cinder-9650bed0-5f41-49b3-9e94-6b11e36f833a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-quobyte-9650bed0-5f41-49b3-9e94-6b11e36f833a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-9650bed0-5f41-49b3-9e94-6b11e36f833a" acquired by "delete_volume" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:33 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a 1073741824" returned: 0 in 1.010s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3e2559-25f3-4662-b119-da908d89e76e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:33 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:33 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:33 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a Aug 17 16:22:33 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:33 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a" returned: 0 in 0.643s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:33 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a Aug 17 16:22:33 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:33 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.609s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc879c0-f1b3-47e3-92f4-9eec9f4fa922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b304131-7115-4e86-90a1-f46968543b5a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656659ba-c2d9-484f-b0ea-5b0afc673306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Volume volume-7b304131-7115-4e86-90a1-f46968543b5a (7b304131-7115-4e86-90a1-f46968543b5a): created successfully Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656659ba-c2d9-484f-b0ea-5b0afc673306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Flow 'volume_create_manager' (66ac2299-608a-421f-b087-41a7f05c9f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3084c64e-8b33-4c99-b916-6c8730c93217 tempest-GroupsV314Test-1857000353 None] Created volume successfully. Aug 17 16:22:34 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9650bed0-5f41-49b3-9e94-6b11e36f833a" returned: 0 in 0.279s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-9650bed0-5f41-49b3-9e94-6b11e36f833a" released by "delete_volume" :: held 1.009s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Created reservations ['8e9e2c12-edf4-41fe-97e3-47a6be75d711', 'b763e787-321f-4d28-8c7b-f587ac429187', '9545f9e0-9ad9-41d1-9103-89dd57eb4c05', '4f3a57ee-7796-4a91-b5d1-20ee33490651'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:34 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:34 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:34 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.309s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Deleted volume successfully. Aug 17 16:22:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ca611d06-e8a3-4633-945a-62ab150384e1 tempest-VolumesActionsTest-328606280 None] Lock "cinder-9650bed0-5f41-49b3-9e94-6b11e36f833a-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:35 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Cloning volume 7b304131-7115-4e86-90a1-f46968543b5a to volume 31ea09d3-dcca-442e-b12b-404a8b923065 Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Creating offline snapshot 451efb80-e006-445c-89db-4a19df9c9494 of volume 7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba20880b-6ed9-44ce-8f6a-538dc32edfd8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:35 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:35 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:35 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.492s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:35 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 1G Aug 17 16:22:35 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (86d2b4f2-2c69-4065-b464-20c90ad6677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4fdc6-050a-4093-b8f2-2d8d2ba67a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4fdc6-050a-4093-b8f2-2d8d2ba67a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732952879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d10a23-0c83-4080-a47c-78cf03f4a26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:36Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8994bd-7e26-40bb-8801-9b420f04b263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b8994bd-7e26-40bb-8801-9b420f04b263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8be1f6-01cb-49ae-94f7-49d7fd802d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8be1f6-01cb-49ae-94f7-49d7fd802d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d10a23-0c83-4080-a47c-78cf03f4a26d', 'volume_name': 'volume-66d10a23-0c83-4080-a47c-78cf03f4a26d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6863aa-e54a-4a9d-bdc1-396dc2c86fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6863aa-e54a-4a9d-bdc1-396dc2c86fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c798fb0-3f5f-4e71-9efe-e44094931e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:36 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Volume 66d10a23-0c83-4080-a47c-78cf03f4a26d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d10a23-0c83-4080-a47c-78cf03f4a26d', 'volume_size': 1} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:36 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 1G" returned: 0 in 0.521s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b304131-7115-4e86-90a1-f46968543b5a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:36 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b304131-7115-4e86-90a1-f46968543b5a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:36 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:36 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b304131-7115-4e86-90a1-f46968543b5a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.520s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:36 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:22:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:36 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:36 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:37 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.310s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:37 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info Aug 17 16:22:37 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:37 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info" returned: 0 in 0.278s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:37 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:37 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info Aug 17 16:22:37 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:37 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.info" returned: 0 in 0.278s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Acquiring lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] snapshot: 451efb80-e006-445c-89db-4a19df9c9494, volume: 31ea09d3-dcca-442e-b12b-404a8b923065, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ce24b-a949-400a-95fd-9b46a7c7f7b2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:38 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:38 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:38 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.426s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b304131-7115-4e86-90a1-f46968543b5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf8e9d-83c9-40d8-bda8-deec4940f973]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:38 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:38 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:38 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.426s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:22:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:38 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 Aug 17 16:22:38 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:45 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065" returned: 0 in 6.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:22:45 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Converted 1024.00 MB image at 160.41 MB/s Aug 17 16:22:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:45 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 Aug 17 16:22:45 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:45 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065" returned: 0 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" released by "_copy_volume_from_snapshot" :: held 7.680s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Acquiring lock "cinder-quobyte-451efb80-e006-445c-89db-4a19df9c9494" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-451efb80-e006-445c-89db-4a19df9c9494" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Deleting offline snapshot 451efb80-e006-445c-89db-4a19df9c9494 of volume 7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] snapshot_file for this snap is: volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f291b-2227-4ed3-b311-fc83175d0deb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:45 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:45 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (4d715e51-a8f5-4221-af59-aa9f279ea52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcf3639-c536-4b61-a362-55c83a0b29ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcf3639-c536-4b61-a362-55c83a0b29ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-806405293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f845a-9621-4708-8b71-8a701e9b6d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:46Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560c678-f4b4-45f5-a5cb-f3ed79a12602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560c678-f4b4-45f5-a5cb-f3ed79a12602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f49729-98c1-465c-ac61-5134cabb03ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f49729-98c1-465c-ac61-5134cabb03ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9f845a-9621-4708-8b71-8a701e9b6d7c', 'volume_name': 'volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d8659-c6dd-4e31-84ee-5c2d569b8274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12d8659-c6dd-4e31-84ee-5c2d569b8274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca7fb4-57a5-4b3f-8b03-ffe3a27e7ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:45 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Volume 4e9f845a-9621-4708-8b71-8a701e9b6d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c', 'volume_size': 1} Aug 17 16:22:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:46 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b304131-7115-4e86-90a1-f46968543b5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6223163-e767-4746-a0e7-7b7101107150]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:46 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:46 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:46 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:46 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:46 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.760s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:46 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:46 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:47 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 28 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:22:47 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.449s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:47 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494 Aug 17 16:22:47 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:47 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a.451efb80-e006-445c-89db-4a19df9c9494" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-451efb80-e006-445c-89db-4a19df9c9494" released by "_delete_snapshot" :: held 2.142s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.516s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.628s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1732952879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d10a23-0c83-4080-a47c-78cf03f4a26d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:36Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Creating volume 66d10a23-0c83-4080-a47c-78cf03f4a26d {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:47 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:47 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d 1073741824 Aug 17 16:22:47 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7ce9185b-0ccd-4f47-8a63-c43538006a13 tempest-GroupsV314Test-1857000353 None] Create group from source-group-56d5d765-0de6-4f4f-92e6-33fe15e112ca completed successfully. Aug 17 16:22:48 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d 1073741824" returned: 0 in 0.506s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:48 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d Aug 17 16:22:48 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:48 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d" returned: 0 in 0.311s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.684s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-806405293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f845a-9621-4708-8b71-8a701e9b6d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fe049843d6548c9b049262c6fe593f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:46Z,use_quota=True,user_id='a8133076f4be4d269ccbd03537300639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Creating volume 4e9f845a-9621-4708-8b71-8a701e9b6d7c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:48 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:48 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c 1073741824 Aug 17 16:22:48 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c798fb0-3f5f-4e71-9efe-e44094931e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d10a23-0c83-4080-a47c-78cf03f4a26d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39014fc-d056-4eaa-a9e9-1c37a6c5db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Volume volume-66d10a23-0c83-4080-a47c-78cf03f4a26d (66d10a23-0c83-4080-a47c-78cf03f4a26d): created successfully Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39014fc-d056-4eaa-a9e9-1c37a6c5db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (86d2b4f2-2c69-4065-b464-20c90ad6677d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2273c421-30cb-4bca-801f-79f072a11a70 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:49 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c 1073741824" returned: 0 in 0.610s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Acquiring lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:49 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c Aug 17 16:22:49 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8912dba-45ac-4931-8e7d-9b1fb3f17630]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:49 devstack sudo[102498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 Aug 17 16:22:49 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:49 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca7fb4-57a5-4b3f-8b03-ffe3a27e7ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafcf15b-e713-47cf-b62e-a57f70b5e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Volume volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c (4e9f845a-9621-4708-8b71-8a701e9b6d7c): created successfully Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafcf15b-e713-47cf-b62e-a57f70b5e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Flow 'volume_create_manager' (4d715e51-a8f5-4221-af59-aa9f279ea52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-862c559d-b62a-47d5-9f55-53985d0e5def tempest-AttachVolumeNegativeTest-1332257649 None] Created volume successfully. Aug 17 16:22:49 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065" returned: 0 in 0.430s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:49 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065 Aug 17 16:22:49 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-66d10a23-0c83-4080-a47c-78cf03f4a26d-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "cinder-66d10a23-0c83-4080-a47c-78cf03f4a26d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Acquiring lock "cinder-quobyte-66d10a23-0c83-4080-a47c-78cf03f4a26d" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-66d10a23-0c83-4080-a47c-78cf03f4a26d" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fb12fc-5aa7-4251-ba5f-65aefab6dc10]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:50 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31ea09d3-dcca-442e-b12b-404a8b923065" returned: 0 in 0.348s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-31ea09d3-dcca-442e-b12b-404a8b923065" released by "delete_volume" :: held 0.840s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Created reservations ['f6e224ed-36b7-4684-a7bc-9058ea2fe6c0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:50 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d Aug 17 16:22:50 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:50 devstack cinder-volume[94468]: WARNING cinder.quota [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-724999657 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-724999657, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:22:50 devstack cinder-volume[94468]: WARNING cinder.quota [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-724999657 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-724999657, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Created reservations ['ac87106d-4eaa-4ac8-8b6e-c3fc3b4a484c', '995a6885-7c3c-4a39-85fc-14537d0702d6', '6f2a64a8-9c13-4f4f-bb8c-74d7b286a08c', 'e3891f59-026b-427c-9bcf-a3ec9ddccdcf'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:50 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:50 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:50 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d" returned: 0 in 0.702s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:50 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d Aug 17 16:22:50 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:51 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5a206469-2e4e-452d-abca-ff53a6c3ee45 tempest-GroupsV314Test-1857000353 None] Delete group completed successfully. Aug 17 16:22:51 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-66d10a23-0c83-4080-a47c-78cf03f4a26d" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "cinder-quobyte-66d10a23-0c83-4080-a47c-78cf03f4a26d" released by "delete_volume" :: held 1.185s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Acquiring lock "cinder-quobyte-7b304131-7115-4e86-90a1-f46968543b5a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-7b304131-7115-4e86-90a1-f46968543b5a" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddbde2-b3a5-4388-876b-0948955a8b6e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Created reservations ['8fd4ae49-1b13-44b3-9ccd-f26a784a82f8', 'bf3b0bf1-96aa-4770-b12f-ee4a7a455e54', 'd2289a2b-c56c-4ff1-8618-96c2b657df7d', '24916798-d6f1-4834-ae60-8de0137c3f1b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:51 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:51 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:51 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:51 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-3e63a50e-038b-491e-8999-316ce00b07d4 req-6e8d2dd1-9673-42a0-9507-a13d73c8fc73 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-3e63a50e-038b-491e-8999-316ce00b07d4 req-6e8d2dd1-9673-42a0-9507-a13d73c8fc73 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-3e63a50e-038b-491e-8999-316ce00b07d4 req-6e8d2dd1-9673-42a0-9507-a13d73c8fc73 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-3e63a50e-038b-491e-8999-316ce00b07d4 req-6e8d2dd1-9673-42a0-9507-a13d73c8fc73 tempest-AttachVolumeNegativeTest-1332257649 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '709626b0-7da5-422f-9590-706b92eda3d9', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:22:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-3e63a50e-038b-491e-8999-316ce00b07d4 req-6e8d2dd1-9673-42a0-9507-a13d73c8fc73 tempest-AttachVolumeNegativeTest-1332257649 None] attachment_update completed successfully. Aug 17 16:22:52 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.647s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:52 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.480s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:52 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Deleted volume successfully. Aug 17 16:22:52 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a Aug 17 16:22:52 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9f881cb-e776-41c9-87dd-9f329196167c tempest-VolumesActionsTest-328606280 None] Lock "cinder-66d10a23-0c83-4080-a47c-78cf03f4a26d-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:52 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b304131-7115-4e86-90a1-f46968543b5a" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Lock "cinder-quobyte-7b304131-7115-4e86-90a1-f46968543b5a" released by "delete_volume" :: held 1.138s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Created reservations ['1b62c7bc-5835-4989-bb13-74db3eca1c68'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Created reservations ['d1496a59-fab7-4d1c-b5b3-037cc43671a1', 'd181eb5a-8f0e-4923-97f4-1372d6a0cdab', '68c0969c-c9fa-4116-882e-e9bee92db23d', 'b91e1091-2c61-4eb6-91af-b63657b53ca1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:52 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:52 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (83c57d34-bc0f-4b19-86de-69b4947955b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29e9e2-59c5-46e8-acd1-197e002fc53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:53 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.456s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0504723c-c44b-49df-9e11-b394e59c2014 tempest-GroupsV314Test-1857000353 None] Delete group completed successfully. Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c29e9e2-59c5-46e8-acd1-197e002fc53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604463701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28620f7-4171-4d38-8580-d765977e54a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:53Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab26290-b45d-4bf8-a738-6030222ee16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab26290-b45d-4bf8-a738-6030222ee16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac17cb4e-53ed-4d4d-b69f-62aa5bec1de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac17cb4e-53ed-4d4d-b69f-62aa5bec1de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28620f7-4171-4d38-8580-d765977e54a4', 'volume_name': 'volume-f28620f7-4171-4d38-8580-d765977e54a4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66aaa23-206b-4c65-9edd-be0c832a3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66aaa23-206b-4c65-9edd-be0c832a3da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa09232-5c86-4ca1-9ec0-1cb969daaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:53 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Volume f28620f7-4171-4d38-8580-d765977e54a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28620f7-4171-4d38-8580-d765977e54a4', 'volume_size': 1} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1604463701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28620f7-4171-4d38-8580-d765977e54a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5048d2168c124d67adb68ac702871bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:22:53Z,use_quota=True,user_id='8f95b9e682c94a138b34765dba286d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Creating volume f28620f7-4171-4d38-8580-d765977e54a4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:22:53 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:22:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:53 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 1073741824 Aug 17 16:22:53 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:54 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 1073741824" returned: 0 in 0.637s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:54 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 Aug 17 16:22:54 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:54 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4" returned: 0 in 0.436s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa09232-5c86-4ca1-9ec0-1cb969daaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28620f7-4171-4d38-8580-d765977e54a4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f3d9fe-2125-4eef-b978-f5b23d00fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:22:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Volume volume-f28620f7-4171-4d38-8580-d765977e54a4 (f28620f7-4171-4d38-8580-d765977e54a4): created successfully Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f3d9fe-2125-4eef-b978-f5b23d00fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:22:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Flow 'volume_create_manager' (83c57d34-bc0f-4b19-86de-69b4947955b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:22:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e5ee2009-c67c-4872-954d-505c085ce022 tempest-VolumesActionsTest-195493845 None] Created volume successfully. Aug 17 16:22:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-4a402e4e-8309-4231-bf5f-83fe4fc36795 req-7d5f0386-f3a0-46ec-a32e-2656423a1f9f tempest-AttachVolumeNegativeTest-1332257649 None] Terminate volume connection completed successfully. Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-4a402e4e-8309-4231-bf5f-83fe4fc36795 req-7d5f0386-f3a0-46ec-a32e-2656423a1f9f tempest-AttachVolumeNegativeTest-1332257649 None] Deleting attachment 709626b0-7da5-422f-9590-706b92eda3d9. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-f28620f7-4171-4d38-8580-d765977e54a4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "cinder-f28620f7-4171-4d38-8580-d765977e54a4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Acquiring lock "cinder-quobyte-f28620f7-4171-4d38-8580-d765977e54a4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "cinder-quobyte-f28620f7-4171-4d38-8580-d765977e54a4" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a338e4f3-0286-4b34-b890-d58ed5c6834f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:22:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:56 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 Aug 17 16:22:56 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:57 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4" returned: 0 in 0.558s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:57 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4 Aug 17 16:22:57 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:57 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f28620f7-4171-4d38-8580-d765977e54a4" returned: 0 in 0.334s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "cinder-quobyte-f28620f7-4171-4d38-8580-d765977e54a4" released by "delete_volume" :: held 0.979s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:22:57 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Created reservations ['74af78ef-72b8-484a-aded-4c30d7028ebd', '3cc12198-d168-40ee-9b37-e7ef359de3c3', '84a51910-1927-41a4-9699-f3bc9bc3d54e', 'f69df96d-b38a-4f17-b309-15ede1456550'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:22:58 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:22:58 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:22:58 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.307s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:22:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Deleted volume successfully. Aug 17 16:22:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-047d33be-9bac-4424-8296-ae7a09d2133a tempest-VolumesActionsTest-195493845 None] Lock "cinder-f28620f7-4171-4d38-8580-d765977e54a4-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-4e9f845a-9621-4708-8b71-8a701e9b6d7c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-4e9f845a-9621-4708-8b71-8a701e9b6d7c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-quobyte-4e9f845a-9621-4708-8b71-8a701e9b6d7c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-4e9f845a-9621-4708-8b71-8a701e9b6d7c" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b8391-f6fd-429c-adff-236e73738f9b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:04 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c Aug 17 16:23:04 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:04 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c" returned: 0 in 0.698s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:05 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c Aug 17 16:23:05 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:05 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e9f845a-9621-4708-8b71-8a701e9b6d7c" returned: 0 in 0.715s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-4e9f845a-9621-4708-8b71-8a701e9b6d7c" released by "delete_volume" :: held 1.524s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Created reservations ['4a664998-f046-458a-adfa-3393ac5fd265', '75bcce89-274e-4c31-9aa2-2438affe2544', 'dd397fff-8390-474f-bf5a-c56e2f8cb9fd', 'd673d7f7-5d13-4c4a-bb17-a7a6541ab811'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:05 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:05 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:06 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.290s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Deleted volume successfully. Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-66f38ab0-3559-4f1d-98c9-de75179f8fd4 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-4e9f845a-9621-4708-8b71-8a701e9b6d7c-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-839aaa12-4c7a-44af-b486-326c4aeaf255-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-839aaa12-4c7a-44af-b486-326c4aeaf255-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-quobyte-839aaa12-4c7a-44af-b486-326c4aeaf255" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-839aaa12-4c7a-44af-b486-326c4aeaf255" acquired by "delete_volume" :: waited 0.051s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf862b-b234-4d3e-921d-97e73e3e4458]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:07 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 Aug 17 16:23:07 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:07 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255" returned: 0 in 0.584s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:07 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255 Aug 17 16:23:07 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:07 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-839aaa12-4c7a-44af-b486-326c4aeaf255" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-839aaa12-4c7a-44af-b486-326c4aeaf255" released by "delete_volume" :: held 1.071s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:07 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=102,cinder:UPDATE=143,cinder:INSERT=27,cinder:DELETE=8 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Created reservations ['b47fc0b0-b023-4f8e-939f-94a6167507ef', '2e404660-5302-4b6e-b213-7a8c71341c7d', '51724856-a01f-4eb6-8d5e-819ba50adc0f', '380a7a56-a198-4184-b8fb-b55b0e33a5cd'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:08 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:08 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:08 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.508s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Deleted volume successfully. Aug 17 16:23:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-841f3e42-0998-4d7f-a482-7cbd04b2bf3b tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-839aaa12-4c7a-44af-b486-326c4aeaf255-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-4f66f8ad-055d-43fc-a2d7-2556e1e7d894-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-4f66f8ad-055d-43fc-a2d7-2556e1e7d894-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=112,cinder:INSERT=34,cinder:UPDATE=129,cinder:DELETE=7 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "cinder-quobyte-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c574c-b6e8-465a-b314-eb643c371304]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:09 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 Aug 17 16:23:09 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:10 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" returned: 0 in 0.596s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:10 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894 Aug 17 16:23:10 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:10 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-quobyte-4f66f8ad-055d-43fc-a2d7-2556e1e7d894" released by "delete_volume" :: held 1.005s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Created reservations ['ab760bce-6585-42d6-9e21-9b3bb7cce379', '1c60a2dd-bb6c-4556-b2b4-f09ffb3325c7', '8f8b8aef-84c9-4cff-ae73-1b2f70025dd1', '850de2f0-ce64-40bc-a705-7ce44771fa14'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:10 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:10 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:11 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.428s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:11 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Deleted volume successfully. Aug 17 16:23:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b4359c24-553e-4d22-adff-71904782b727 tempest-AttachVolumeNegativeTest-1332257649 None] Lock "cinder-4f66f8ad-055d-43fc-a2d7-2556e1e7d894-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:20 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Flow 'volume_create_manager' (1d3afb17-7016-4c26-8580-0e9fe268473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b712a05-7088-4a0f-8768-2746d2c7662f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b712a05-7088-4a0f-8768-2746d2c7662f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1293788405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97528051-1d07-4460-8aef-0dcfc8ba704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd07e03baa54874bded1face6a3cd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:22Z,use_quota=True,user_id='1e6e6c47aded480691d12722ba13bbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed21124-4778-438d-bf29-26403bf4c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed21124-4778-438d-bf29-26403bf4c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f99b0ee-e1ec-469c-9d2c-07c2b26a6790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f99b0ee-e1ec-469c-9d2c-07c2b26a6790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97528051-1d07-4460-8aef-0dcfc8ba704f', 'volume_name': 'volume-97528051-1d07-4460-8aef-0dcfc8ba704f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc29fc5-bea8-476a-a101-b9051ab594f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc29fc5-bea8-476a-a101-b9051ab594f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0acf0c-f77e-4365-a6eb-a6bdfcd36ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Volume 97528051-1d07-4460-8aef-0dcfc8ba704f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97528051-1d07-4460-8aef-0dcfc8ba704f', 'volume_size': 1} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1293788405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97528051-1d07-4460-8aef-0dcfc8ba704f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cd07e03baa54874bded1face6a3cd90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:22Z,use_quota=True,user_id='1e6e6c47aded480691d12722ba13bbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Creating volume 97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:21 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f 1073741824 Aug 17 16:23:21 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:22 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f 1073741824" returned: 0 in 0.957s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:23 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f Aug 17 16:23:23 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:23 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f" returned: 0 in 0.418s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0acf0c-f77e-4365-a6eb-a6bdfcd36ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97528051-1d07-4460-8aef-0dcfc8ba704f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5dae28-c271-4f7f-a343-f90e92652c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Volume volume-97528051-1d07-4460-8aef-0dcfc8ba704f (97528051-1d07-4460-8aef-0dcfc8ba704f): created successfully Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5dae28-c271-4f7f-a343-f90e92652c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Flow 'volume_create_manager' (1d3afb17-7016-4c26-8580-0e9fe268473b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9bf7b977-9c36-4222-b9dd-5d5eb956d122 tempest-SnapshotMetadataTestJSON-1604282676 None] Created volume successfully. Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Flow 'volume_create_manager' (4116df6f-d720-40e0-9588-fb5e2a62a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69caf8-aa62-40f3-ab1e-470e3b46601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d69caf8-aa62-40f3-ab1e-470e3b46601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1422291205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b2794-3292-43af-86ec-984db9ca3ffd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d00f669920f74de4ae41018d98fa2fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:24Z,use_quota=True,user_id='4d759dd84614444faa490b350fedc3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d692f7de-1b58-43f7-8a2b-f26dd5392aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d692f7de-1b58-43f7-8a2b-f26dd5392aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7133e0-dc8c-46a2-8f61-785c256b4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7133e0-dc8c-46a2-8f61-785c256b4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949b2794-3292-43af-86ec-984db9ca3ffd', 'volume_name': 'volume-949b2794-3292-43af-86ec-984db9ca3ffd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb0f22f-7888-4315-aa26-6f9fadf7edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb0f22f-7888-4315-aa26-6f9fadf7edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8ad17e-4fe3-466d-a30c-d67e7cad49f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Volume 949b2794-3292-43af-86ec-984db9ca3ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949b2794-3292-43af-86ec-984db9ca3ffd', 'volume_size': 1} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1422291205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949b2794-3292-43af-86ec-984db9ca3ffd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d00f669920f74de4ae41018d98fa2fd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:24Z,use_quota=True,user_id='4d759dd84614444faa490b350fedc3aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Creating volume 949b2794-3292-43af-86ec-984db9ca3ffd {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:24 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:24 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd 1073741824 Aug 17 16:23:24 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:24 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd 1073741824" returned: 0 in 0.576s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:24 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd Aug 17 16:23:24 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:25 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd" returned: 0 in 0.310s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.897s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8ad17e-4fe3-466d-a30c-d67e7cad49f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949b2794-3292-43af-86ec-984db9ca3ffd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60bd21e-c0b1-4929-a067-5e03f3b665fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Creating offline snapshot 27487139-4454-4b34-9a40-dbaa29534a48 of volume 97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:23:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Volume volume-949b2794-3292-43af-86ec-984db9ca3ffd (949b2794-3292-43af-86ec-984db9ca3ffd): created successfully Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60bd21e-c0b1-4929-a067-5e03f3b665fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Flow 'volume_create_manager' (4116df6f-d720-40e0-9588-fb5e2a62a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9f3eea-e394-48da-9f8b-00177d68c7ba]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-0148eaeb-1fb5-4657-94fe-0fb5d7795035 req-40cb1e5f-cbdc-4eec-a39f-a89dd4af5414 tempest-VolumesGetTestJSON-1273246622 None] Created volume successfully. Aug 17 16:23:25 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f Aug 17 16:23:25 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Flow 'volume_create_manager' (067e13a0-6a32-4b67-94f1-0894c231b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8777796-2171-49a5-9d93-2e774e12d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8777796-2171-49a5-9d93-2e774e12d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1054984752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49953d16-95d6-4a1e-9c64-94a9720070f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553675c507b4bd184c811afeeef422e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:25Z,use_quota=True,user_id='df460ad2eaf04c6e81ab9d941a436231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4e6d80-8eff-428f-9e0a-9d59e3fce7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4e6d80-8eff-428f-9e0a-9d59e3fce7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ab228a-5f65-4797-918c-f3930b6c931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ab228a-5f65-4797-918c-f3930b6c931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49953d16-95d6-4a1e-9c64-94a9720070f4', 'volume_name': 'volume-49953d16-95d6-4a1e-9c64-94a9720070f4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4074a2-0202-4aec-acbf-1469b018b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4074a2-0202-4aec-acbf-1469b018b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbffecb-08e9-41f0-8031-1fc890516612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Volume 49953d16-95d6-4a1e-9c64-94a9720070f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49953d16-95d6-4a1e-9c64-94a9720070f4', 'volume_size': 1} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:25 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f" returned: 0 in 0.439s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:25 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 1G Aug 17 16:23:25 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:26 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 1G" returned: 0 in 0.472s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97528051-1d07-4460-8aef-0dcfc8ba704f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:26 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97528051-1d07-4460-8aef-0dcfc8ba704f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 Aug 17 16:23:26 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:26 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97528051-1d07-4460-8aef-0dcfc8ba704f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48" returned: 0 in 0.358s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:26 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 is being set with open permissions: ugo+rw Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:26 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 Aug 17 16:23:26 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:26 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Acquiring lock "cinder-949b2794-3292-43af-86ec-984db9ca3ffd-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "cinder-949b2794-3292-43af-86ec-984db9ca3ffd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Acquiring lock "cinder-quobyte-949b2794-3292-43af-86ec-984db9ca3ffd" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:26 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info Aug 17 16:23:26 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "cinder-quobyte-949b2794-3292-43af-86ec-984db9ca3ffd" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a3287a-7b4e-4ca0-87df-abbe35680392]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:27 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd Aug 17 16:23:27 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:27 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info" returned: 0 in 0.305s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:27 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info is being set with open permissions: ugo+rw Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:27 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info Aug 17 16:23:27 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:27 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd" returned: 0 in 0.486s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:27 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd Aug 17 16:23:27 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:27 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.info" returned: 0 in 0.312s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1054984752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49953d16-95d6-4a1e-9c64-94a9720070f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553675c507b4bd184c811afeeef422e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:25Z,use_quota=True,user_id='df460ad2eaf04c6e81ab9d941a436231',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Creating volume 49953d16-95d6-4a1e-9c64-94a9720070f4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:27 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 1073741824 Aug 17 16:23:27 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f95bd9e9-192e-4e96-8727-1cdcf59e0b34 tempest-SnapshotMetadataTestJSON-1604282676 None] Create snapshot completed successfully Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (cf65f7f5-3799-4f38-b475-e7f8dcb67e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390a65f8-1d35-4154-a12d-568fee86773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390a65f8-1d35-4154-a12d-568fee86773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-81830498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a436cd-0dda-4a2a-9407-77b481017b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:28Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baa3eb4-3f74-4ac9-a82a-c789caee7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baa3eb4-3f74-4ac9-a82a-c789caee7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f611e1-a189-48c8-905c-7dc869b9320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f611e1-a189-48c8-905c-7dc869b9320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a436cd-0dda-4a2a-9407-77b481017b18', 'volume_name': 'volume-c5a436cd-0dda-4a2a-9407-77b481017b18', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:27 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9824947a-8cff-4fc8-a9ab-43078a8ad67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9824947a-8cff-4fc8-a9ab-43078a8ad67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe50c2e8-f24c-469f-9241-ab61c8e592aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Volume c5a436cd-0dda-4a2a-9407-77b481017b18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a436cd-0dda-4a2a-9407-77b481017b18', 'volume_size': 1} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-949b2794-3292-43af-86ec-984db9ca3ffd" returned: 0 in 0.363s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "cinder-quobyte-949b2794-3292-43af-86ec-984db9ca3ffd" released by "delete_volume" :: held 0.903s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:27 devstack cinder-volume[94468]: DEBUG cinder.quota [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Created reservations ['22826900-c0f3-439e-abb2-f4eec64b324e', '5c3eb0e6-292f-4739-986c-0a9a875b230f', 'b36a259a-61e4-4a17-b8b3-91372ff2d225', '1e61ddaf-9b34-4ba7-a3c7-c126edf03592'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:28 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:28 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:28 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 1073741824" returned: 0 in 0.577s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:28 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 Aug 17 16:23:28 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:28 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.manager [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Deleted volume successfully. Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-b031774a-a24d-42d9-91d4-5ff40a6bdc0f req-1e125bcf-b2d0-4657-8677-f5a7bd50c8a9 tempest-VolumesGetTestJSON-1273246622 None] Lock "cinder-949b2794-3292-43af-86ec-984db9ca3ffd-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:28 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-81830498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a436cd-0dda-4a2a-9407-77b481017b18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:28Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Creating volume c5a436cd-0dda-4a2a-9407-77b481017b18 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:28 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bbffecb-08e9-41f0-8031-1fc890516612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49953d16-95d6-4a1e-9c64-94a9720070f4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:28 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 1073741824 Aug 17 16:23:28 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1547ac-7e25-40e9-ace6-1d5b9a8d7751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Volume volume-49953d16-95d6-4a1e-9c64-94a9720070f4 (49953d16-95d6-4a1e-9c64-94a9720070f4): created successfully Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1547ac-7e25-40e9-ace6-1d5b9a8d7751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Flow 'volume_create_manager' (067e13a0-6a32-4b67-94f1-0894c231b56e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-912630d5-91a2-43e3-a9c1-315d775d50ac tempest-VolumesMetadataTest-773838805 None] Created volume successfully. Aug 17 16:23:29 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 1073741824" returned: 0 in 0.747s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:29 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 Aug 17 16:23:29 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "cinder-27487139-4454-4b34-9a40-dbaa29534a48-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-27487139-4454-4b34-9a40-dbaa29534a48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "cinder-quobyte-27487139-4454-4b34-9a40-dbaa29534a48" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-27487139-4454-4b34-9a40-dbaa29534a48" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Deleting offline snapshot 27487139-4454-4b34-9a40-dbaa29534a48 of volume 97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] snapshot_file for this snap is: volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b8d8d-1f97-42bc-974f-1faf433b7015]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:29 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:29 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 Aug 17 16:23:29 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe50c2e8-f24c-469f-9241-ab61c8e592aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a436cd-0dda-4a2a-9407-77b481017b18', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d4cae-14da-4240-9b25-01fe97a4a78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Volume volume-c5a436cd-0dda-4a2a-9407-77b481017b18 (c5a436cd-0dda-4a2a-9407-77b481017b18): created successfully Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47d4cae-14da-4240-9b25-01fe97a4a78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (cf65f7f5-3799-4f38-b475-e7f8dcb67e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1fce523a-3388-4cae-a29d-0da645a427db tempest-AttachVolumeTestJSON-1096176667 None] Created volume successfully. Aug 17 16:23:30 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48" returned: 0 in 0.535s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97528051-1d07-4460-8aef-0dcfc8ba704f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb71214a-7c1e-468a-90e3-051120c70ae8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:30 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f Aug 17 16:23:30 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:30 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f" returned: 0 in 0.420s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:30 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 Aug 17 16:23:30 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Acquiring lock "cinder-49953d16-95d6-4a1e-9c64-94a9720070f4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "cinder-49953d16-95d6-4a1e-9c64-94a9720070f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Acquiring lock "cinder-quobyte-49953d16-95d6-4a1e-9c64-94a9720070f4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "cinder-quobyte-49953d16-95d6-4a1e-9c64-94a9720070f4" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a094479-4cba-4c34-b186-010aeca26ac3]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:31 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 Aug 17 16:23:31 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:31 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48" returned: 0 in 0.487s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:31 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48 Aug 17 16:23:31 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:31 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4" returned: 0 in 0.517s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:31 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4 Aug 17 16:23:31 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:31 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f.27487139-4454-4b34-9a40-dbaa29534a48" returned: 0 in 0.369s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-27487139-4454-4b34-9a40-dbaa29534a48" released by "_delete_snapshot" :: held 1.958s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" released by "delete_snapshot" :: held 1.997s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Created reservations ['160ef115-59b0-4e68-b6cc-4374d6d4a380', '8f746350-36e5-4a3f-bb71-23150dc33589', '34311bc2-755b-4816-ad17-b7e36c01c352', '8da685a3-5579-4730-abda-a6ceb9a198c2'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Delete snapshot completed successfully. Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f1804d7-3675-404a-881c-c07ac9e95463 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-27487139-4454-4b34-9a40-dbaa29534a48-delete_snapshot" released by "delete_snapshot" :: held 2.256s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:31 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-49953d16-95d6-4a1e-9c64-94a9720070f4" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "cinder-quobyte-49953d16-95d6-4a1e-9c64-94a9720070f4" released by "delete_volume" :: held 0.971s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:31 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Created reservations ['2df84976-7dcc-4019-809e-bc5878e6197b', '4927dbfe-4459-4c9e-8201-d18db54cc75c', 'bf8e7158-24f2-440c-92a0-28ea420a2117', '6b539b5c-4997-4ada-9ced-31696e387504'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:32 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:32 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d29c62c7-7b6e-4018-ae96-18c8041397af req-7c49645c-5b9d-47f3-8fda-ff9c354ad989 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d29c62c7-7b6e-4018-ae96-18c8041397af req-7c49645c-5b9d-47f3-8fda-ff9c354ad989 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d29c62c7-7b6e-4018-ae96-18c8041397af req-7c49645c-5b9d-47f3-8fda-ff9c354ad989 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-d29c62c7-7b6e-4018-ae96-18c8041397af req-7c49645c-5b9d-47f3-8fda-ff9c354ad989 tempest-AttachVolumeTestJSON-1096176667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-c5a436cd-0dda-4a2a-9407-77b481017b18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46089c8c-fe2b-47fb-8923-a33b50ae9d97', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:23:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-d29c62c7-7b6e-4018-ae96-18c8041397af req-7c49645c-5b9d-47f3-8fda-ff9c354ad989 tempest-AttachVolumeTestJSON-1096176667 None] attachment_update completed successfully. Aug 17 16:23:32 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Deleted volume successfully. Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d0412ad3-8f5e-45c8-b0b2-798ae960d13c tempest-VolumesMetadataTest-773838805 None] Lock "cinder-49953d16-95d6-4a1e-9c64-94a9720070f4-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "cinder-97528051-1d07-4460-8aef-0dcfc8ba704f-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-97528051-1d07-4460-8aef-0dcfc8ba704f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f08f7a-cc62-4957-a014-9e4f2e9cf528]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:33 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f Aug 17 16:23:33 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (e2fba87d-bc10-406b-8e56-0488821f67b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba058c51-a128-4d87-8360-abce2bdf9540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba058c51-a128-4d87-8360-abce2bdf9540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1880736749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a1b302-1531-4980-8e77-ee40ba75fb42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:33Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2b22a4-823c-4451-8a8a-db2764a71a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2b22a4-823c-4451-8a8a-db2764a71a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfc996f-852d-4671-aa4a-f4f907d4d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfc996f-852d-4671-aa4a-f4f907d4d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a1b302-1531-4980-8e77-ee40ba75fb42', 'volume_name': 'volume-f8a1b302-1531-4980-8e77-ee40ba75fb42', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c9ed76-ee0a-4c64-9507-e6d014a5313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c9ed76-ee0a-4c64-9507-e6d014a5313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13633723-0f53-4d8a-a413-b3cb103cbb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Volume f8a1b302-1531-4980-8e77-ee40ba75fb42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a1b302-1531-4980-8e77-ee40ba75fb42', 'volume_size': 1} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1880736749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a1b302-1531-4980-8e77-ee40ba75fb42,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:33Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Creating volume f8a1b302-1531-4980-8e77-ee40ba75fb42 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:33 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f" returned: 0 in 0.512s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:33 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 1073741824 Aug 17 16:23:33 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:33 devstack sudo[103753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f Aug 17 16:23:33 devstack sudo[103753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:33 devstack sudo[103753]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-97528051-1d07-4460-8aef-0dcfc8ba704f" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-quobyte-97528051-1d07-4460-8aef-0dcfc8ba704f" released by "delete_volume" :: held 0.965s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Created reservations ['2eb0d0e6-7c56-4ab1-80d3-c0d876861b33', 'f3eb5316-07fb-4ea9-9e3d-2cb624f9335f', 'b9b691f4-94c5-47cc-9260-1e612c6f73fd', '7c281fbe-aa34-4e39-93ea-e7817aa69bb0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:34 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:34 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 1073741824" returned: 0 in 0.758s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:34 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:34 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 Aug 17 16:23:34 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:34 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.466s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:34 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Deleted volume successfully. Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13633723-0f53-4d8a-a413-b3cb103cbb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a1b302-1531-4980-8e77-ee40ba75fb42', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0545bda5-c8fa-4fa6-99bb-8c1d03724028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6f333c0-fcd1-4266-9955-c248ec7ea824 tempest-SnapshotMetadataTestJSON-1604282676 None] Lock "cinder-97528051-1d07-4460-8aef-0dcfc8ba704f-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Volume volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 (f8a1b302-1531-4980-8e77-ee40ba75fb42): created successfully Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0545bda5-c8fa-4fa6-99bb-8c1d03724028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (e2fba87d-bc10-406b-8e56-0488821f67b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8d08e81a-5729-4c83-8ac3-c9ba41aca2f3 tempest-VolumesTestJSON-1375322446 None] Created volume successfully. Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (a7cf065f-33d0-4bc2-8b5b-665294770a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9c33a7-0b46-4685-8791-9a6ba0a2db0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a9c33a7-0b46-4685-8791-9a6ba0a2db0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1766336143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bb5e55-0708-461d-88fa-25af1d718ee9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:36Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62136199-874c-442f-bc91-5f9490565022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62136199-874c-442f-bc91-5f9490565022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8329065-e5cc-4757-ae8a-ed0eb01e1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8329065-e5cc-4757-ae8a-ed0eb01e1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71bb5e55-0708-461d-88fa-25af1d718ee9', 'volume_name': 'volume-71bb5e55-0708-461d-88fa-25af1d718ee9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16f7425-05fa-4c02-af13-8041aa46f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c16f7425-05fa-4c02-af13-8041aa46f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5503af67-c9cb-4205-98ba-ed903f28937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:36 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Volume 71bb5e55-0708-461d-88fa-25af1d718ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71bb5e55-0708-461d-88fa-25af1d718ee9', 'volume_size': 1} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1766336143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bb5e55-0708-461d-88fa-25af1d718ee9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:36Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Creating volume 71bb5e55-0708-461d-88fa-25af1d718ee9 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:36 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:36 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 1073741824 Aug 17 16:23:36 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:37 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 1073741824" returned: 0 in 0.723s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:37 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 Aug 17 16:23:37 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:37 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5503af67-c9cb-4205-98ba-ed903f28937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bb5e55-0708-461d-88fa-25af1d718ee9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e981b6-edc7-4f17-ac9f-c991730bb8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Volume volume-71bb5e55-0708-461d-88fa-25af1d718ee9 (71bb5e55-0708-461d-88fa-25af1d718ee9): created successfully Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e981b6-edc7-4f17-ac9f-c991730bb8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (a7cf065f-33d0-4bc2-8b5b-665294770a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-87f04187-5295-4eab-a0c1-ed2b7cd0c062 tempest-VolumesTestJSON-1375322446 None] Created volume successfully. Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (aeb95366-825c-49a4-8292-6b4f5c4cb168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef558c0b-c5e0-4388-8172-046e9975c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef558c0b-c5e0-4388-8172-046e9975c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1274852078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d969b6e4-3761-45f2-a3e7-aaa5359aa385,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:39Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa29eb3-e003-4b1e-8ced-eb04eba1980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa29eb3-e003-4b1e-8ced-eb04eba1980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3f694-4bc9-40f7-aa0d-3c1cb206334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d3f694-4bc9-40f7-aa0d-3c1cb206334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd969b6e4-3761-45f2-a3e7-aaa5359aa385', 'volume_name': 'volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c846a15-66ee-40e3-a0b8-5a07bfedc8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c846a15-66ee-40e3-a0b8-5a07bfedc8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2a6703-23de-42f2-9871-c89470065202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Volume d969b6e4-3761-45f2-a3e7-aaa5359aa385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385', 'volume_size': 1} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1274852078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d969b6e4-3761-45f2-a3e7-aaa5359aa385,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='32bc1932446a4fc6b6689330b5933404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:39Z,use_quota=True,user_id='9689f0d51a0b40938ee080fe22bf1f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Creating volume d969b6e4-3761-45f2-a3e7-aaa5359aa385 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:39 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:39 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 1073741824 Aug 17 16:23:39 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Flow 'volume_create_manager' (69bc4db3-cfee-456d-969e-7ef1a03400d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2cc5db-5f7b-44f8-81be-5c446cc9473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2cc5db-5f7b-44f8-81be-5c446cc9473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-237559699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45679511-3cd8-4240-862c-4391dc84d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379601b75979462295d424af8f8c7104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:40Z,use_quota=True,user_id='f1ffa16bc5364fb4832e6d1190c61279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501c4c00-1775-4a72-b59c-757f4146ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501c4c00-1775-4a72-b59c-757f4146ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658baa6-9aca-4a2e-8266-82392a0cf255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c658baa6-9aca-4a2e-8266-82392a0cf255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45679511-3cd8-4240-862c-4391dc84d19b', 'volume_name': 'volume-45679511-3cd8-4240-862c-4391dc84d19b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e03399-dc9d-4d75-a375-937a1c125c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e03399-dc9d-4d75-a375-937a1c125c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14508d0f-18ce-479c-af4c-66a47ffd4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:40 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Volume 45679511-3cd8-4240-862c-4391dc84d19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45679511-3cd8-4240-862c-4391dc84d19b', 'volume_size': 1} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:40 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 1073741824" returned: 0 in 1.120s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:40 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 Aug 17 16:23:40 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:41 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385" returned: 0 in 0.378s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-237559699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45679511-3cd8-4240-862c-4391dc84d19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379601b75979462295d424af8f8c7104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:40Z,use_quota=True,user_id='f1ffa16bc5364fb4832e6d1190c61279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Creating volume 45679511-3cd8-4240-862c-4391dc84d19b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:41 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:41 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b 1073741824 Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2a6703-23de-42f2-9871-c89470065202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:41 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908845d5-9029-4f59-aeff-23159985f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Volume volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 (d969b6e4-3761-45f2-a3e7-aaa5359aa385): created successfully Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908845d5-9029-4f59-aeff-23159985f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Flow 'volume_create_manager' (aeb95366-825c-49a4-8292-6b4f5c4cb168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a7a47c34-3b9f-45e5-8022-97bd4c7c6387 tempest-VolumesTestJSON-1375322446 None] Created volume successfully. Aug 17 16:23:41 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b 1073741824" returned: 0 in 0.723s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:42 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b Aug 17 16:23:42 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:42 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b" returned: 0 in 0.357s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14508d0f-18ce-479c-af4c-66a47ffd4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45679511-3cd8-4240-862c-4391dc84d19b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f25e12-918c-445c-8438-83087849b47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Volume volume-45679511-3cd8-4240-862c-4391dc84d19b (45679511-3cd8-4240-862c-4391dc84d19b): created successfully Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f25e12-918c-445c-8438-83087849b47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Flow 'volume_create_manager' (69bc4db3-cfee-456d-969e-7ef1a03400d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-261c6d05-7294-4be8-b343-5e916c9fdae5 tempest-VolumesTransfersV355Test-1526598692 None] Created volume successfully. Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Flow 'volume_create_manager' (2696336c-a8c0-457c-affb-c0871cc24195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec770df-031e-4755-88f2-1282d9a8632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec770df-031e-4755-88f2-1282d9a8632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1217933873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc7a1c6-fd64-4739-baf7-3a93d01e7806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8130a3b1288b4bb7903205d23a9247f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:42Z,use_quota=True,user_id='cb8cea1964854aee9963dd2740668c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8027e0-8d27-46aa-8c59-19c32fab22dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8027e0-8d27-46aa-8c59-19c32fab22dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7246d-620b-4476-b512-8857f7096308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f7246d-620b-4476-b512-8857f7096308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc7a1c6-fd64-4739-baf7-3a93d01e7806', 'volume_name': 'volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074ecf28-e0b1-48aa-af92-58a5fda5d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074ecf28-e0b1-48aa-af92-58a5fda5d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32dc094-6ca6-45df-942e-bb557194cd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Volume ecc7a1c6-fd64-4739-baf7-3a93d01e7806: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806', 'volume_size': 1} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1217933873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc7a1c6-fd64-4739-baf7-3a93d01e7806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8130a3b1288b4bb7903205d23a9247f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:42Z,use_quota=True,user_id='cb8cea1964854aee9963dd2740668c8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Creating volume ecc7a1c6-fd64-4739-baf7-3a93d01e7806 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:42 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:42 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 1073741824 Aug 17 16:23:42 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-d969b6e4-3761-45f2-a3e7-aaa5359aa385-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "cinder-d969b6e4-3761-45f2-a3e7-aaa5359aa385-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:43 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-quobyte-d969b6e4-3761-45f2-a3e7-aaa5359aa385" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 1073741824" returned: 0 in 0.774s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-d969b6e4-3761-45f2-a3e7-aaa5359aa385" acquired by "delete_volume" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b385df55-c664-45c5-8aa1-355a44b1383b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:43 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 Aug 17 16:23:43 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:43 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 Aug 17 16:23:43 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:43 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" returned: 0 in 0.397s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32dc094-6ca6-45df-942e-bb557194cd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b9d728-0359-46fa-a335-889d6f319f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:43 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Volume volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 (ecc7a1c6-fd64-4739-baf7-3a93d01e7806): created successfully Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b9d728-0359-46fa-a335-889d6f319f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Flow 'volume_create_manager' (2696336c-a8c0-457c-affb-c0871cc24195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-16ebb518-a09b-452b-982e-5c5a47ab293d tempest-AbsoluteLimitsTests-154680138 None] Created volume successfully. Aug 17 16:23:44 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:44 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385 Aug 17 16:23:44 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:44 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d969b6e4-3761-45f2-a3e7-aaa5359aa385" returned: 0 in 0.311s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-d969b6e4-3761-45f2-a3e7-aaa5359aa385" released by "delete_volume" :: held 0.918s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Created reservations ['ac076225-4b28-4d33-ba24-09ba40684062', 'b181f107-2046-4d47-91c1-455c069475aa', '8ec7bc1e-fe0f-49ca-ad31-3ac762173935', '1b1026e6-05f4-455f-9e04-fe46e3df7f66'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2f3e0b6c-ddd9-4747-99eb-9b309fd6187f tempest-VolumesTransfersV355Test-1340718438 None] Transfer volume completed successfully. Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:44 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:44 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Acquiring lock "cinder-ecc7a1c6-fd64-4739-baf7-3a93d01e7806-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "cinder-ecc7a1c6-fd64-4739-baf7-3a93d01e7806-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Acquiring lock "cinder-quobyte-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "cinder-quobyte-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e1d5e-8ae6-4ecb-81ae-54467a96dd41]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:45 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.588s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Deleted volume successfully. Aug 17 16:23:45 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 Aug 17 16:23:45 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9032d0f7-4eb5-483e-8660-dcd36bdd2aef tempest-VolumesTestJSON-1375322446 None] Lock "cinder-d969b6e4-3761-45f2-a3e7-aaa5359aa385-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:45 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" returned: 0 in 0.563s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-71bb5e55-0708-461d-88fa-25af1d718ee9-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:45 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806 Aug 17 16:23:45 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-71bb5e55-0708-461d-88fa-25af1d718ee9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "cinder-45679511-3cd8-4240-862c-4391dc84d19b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-quobyte-71bb5e55-0708-461d-88fa-25af1d718ee9" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-45679511-3cd8-4240-862c-4391dc84d19b-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-71bb5e55-0708-461d-88fa-25af1d718ee9" acquired by "delete_volume" :: waited 0.052s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de26349-a531-4280-9ca6-92d2ee4cafb4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "cinder-quobyte-45679511-3cd8-4240-862c-4391dc84d19b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:46 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" returned: 0 in 0.481s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-quobyte-45679511-3cd8-4240-862c-4391dc84d19b" acquired by "delete_volume" :: waited 0.051s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "cinder-quobyte-ecc7a1c6-fd64-4739-baf7-3a93d01e7806" released by "delete_volume" :: held 1.153s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ac675-b260-4423-9a59-76de09a371fd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Created reservations ['ff863466-9705-403a-b787-21a7f2deb959', '5de2ae7f-08e5-4aba-9ddb-a5a25359ebb2', '59d7ce6a-fc66-4cf3-abb8-6c960f062f1f', '0b1be8e8-6119-48ff-96a3-5837067a2bd2'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:46 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:46 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b Aug 17 16:23:46 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:46 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:46 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:46 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9" returned: 0 in 0.778s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b" returned: 0 in 0.657s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:46 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9 Aug 17 16:23:46 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:46 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.491s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:47 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b Aug 17 16:23:47 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Deleted volume successfully. Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9ba51a55-da26-496e-bd9a-90b94456b597 tempest-AbsoluteLimitsTests-154680138 None] Lock "cinder-ecc7a1c6-fd64-4739-baf7-3a93d01e7806-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:47 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 28 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:23:47 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-71bb5e55-0708-461d-88fa-25af1d718ee9" returned: 0 in 0.397s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-71bb5e55-0708-461d-88fa-25af1d718ee9" released by "delete_volume" :: held 1.274s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:47 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Created reservations ['99dfd108-bd56-4bd4-8dd3-864aac0006bd', '1c4f70fc-cbf1-4986-9bea-294e30fee6d7', '5e812ed8-d90c-4119-9891-27e3e50f7fa4', '4396d70c-d7d9-475f-888a-1b5a00bd4fc8'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-45679511-3cd8-4240-862c-4391dc84d19b" returned: 0 in 0.445s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-quobyte-45679511-3cd8-4240-862c-4391dc84d19b" released by "delete_volume" :: held 1.189s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:47 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:47 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Created reservations ['10180a5b-d8b0-4198-b8fa-a917544bbcb7', '9956d71e-fb34-4e05-8652-54b9cdacd29f', '5aeed290-cd38-4347-ac61-8de2942bfdc4', 'f23b6444-be1d-47e1-9384-df2c126eca49'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:47 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:47 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:47 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.320s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Deleted volume successfully. Aug 17 16:23:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0e0468da-6983-4a6b-8c0d-4cd26b37e594 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-71bb5e55-0708-461d-88fa-25af1d718ee9-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:48 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Deleted volume successfully. Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c21c611-7591-4bde-b650-e2d578d03c3b tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-45679511-3cd8-4240-862c-4391dc84d19b-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-f8a1b302-1531-4980-8e77-ee40ba75fb42-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-f8a1b302-1531-4980-8e77-ee40ba75fb42-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "cinder-quobyte-f8a1b302-1531-4980-8e77-ee40ba75fb42" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-f8a1b302-1531-4980-8e77-ee40ba75fb42" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe025b-4eed-4045-ab5e-9fbbdfcba203]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:48 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 Aug 17 16:23:48 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Flow 'volume_create_manager' (f2380a27-e979-4519-9e12-f8cc2e24b300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fcaa8e-c21b-44d9-979e-6103f8a7cffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fcaa8e-c21b-44d9-979e-6103f8a7cffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573955543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1e35f0-ff6f-4229-bfab-3f26a244ef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379601b75979462295d424af8f8c7104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:49Z,use_quota=True,user_id='f1ffa16bc5364fb4832e6d1190c61279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8959a2-49eb-4cc3-9d36-448533e3ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8959a2-49eb-4cc3-9d36-448533e3ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389352df-2ad6-4125-ba4d-f839f256ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389352df-2ad6-4125-ba4d-f839f256ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1e35f0-ff6f-4229-bfab-3f26a244ef03', 'volume_name': 'volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae405dd-4f6c-4d77-8d5e-b49c0770a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae405dd-4f6c-4d77-8d5e-b49c0770a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4088fb3-08bd-499a-bbfb-c162001b3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Volume 9d1e35f0-ff6f-4229-bfab-3f26a244ef03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03', 'volume_size': 1} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1573955543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1e35f0-ff6f-4229-bfab-3f26a244ef03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='379601b75979462295d424af8f8c7104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:23:49Z,use_quota=True,user_id='f1ffa16bc5364fb4832e6d1190c61279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Creating volume 9d1e35f0-ff6f-4229-bfab-3f26a244ef03 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:23:49 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:49 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42" returned: 0 in 0.850s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:49 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 1073741824 Aug 17 16:23:49 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:49 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42 Aug 17 16:23:49 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:49 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f8a1b302-1531-4980-8e77-ee40ba75fb42" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-quobyte-f8a1b302-1531-4980-8e77-ee40ba75fb42" released by "delete_volume" :: held 1.375s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Created reservations ['a84b6e67-07ea-4315-816e-c4fb71dd8d41', 'de5c0ad0-15de-43c7-b73d-0742ad7eef65', '57c52d21-b311-4e3b-9b95-2f919074479e', '566435cb-86eb-4f16-94e0-1c4c2e78d127'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:49 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:49 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:50 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 1073741824" returned: 0 in 0.825s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:50 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 Aug 17 16:23:50 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:50 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.478s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Deleted volume successfully. Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-da72c955-4bcd-42ff-896a-cd1b0268e267 tempest-VolumesTestJSON-1375322446 None] Lock "cinder-f8a1b302-1531-4980-8e77-ee40ba75fb42-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:50 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" returned: 0 in 0.373s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4088fb3-08bd-499a-bbfb-c162001b3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a0681-69d9-45e0-a320-1047c87ef572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:23:50 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Volume volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 (9d1e35f0-ff6f-4229-bfab-3f26a244ef03): created successfully Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a0681-69d9-45e0-a320-1047c87ef572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:23:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Flow 'volume_create_manager' (f2380a27-e979-4519-9e12-f8cc2e24b300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:23:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-93d5738c-d976-44a6-bd40-523cf0ddec99 tempest-VolumesTransfersV355Test-1526598692 None] Created volume successfully. Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "cinder-9d1e35f0-ff6f-4229-bfab-3f26a244ef03-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-9d1e35f0-ff6f-4229-bfab-3f26a244ef03-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "cinder-quobyte-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-quobyte-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9de8b67-1418-41fd-84c4-cd1513444d9a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:23:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:52 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 Aug 17 16:23:52 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:52 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" returned: 0 in 0.501s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:52 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03 Aug 17 16:23:52 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:52 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" returned: 0 in 0.462s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-quobyte-9d1e35f0-ff6f-4229-bfab-3f26a244ef03" released by "delete_volume" :: held 1.053s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Created reservations ['e9075d41-2fc9-41e8-ab0f-c680caee863b', 'b4a98143-43ab-44ef-a55a-0a8af1379699', '23d885a8-0cf3-43ae-b8bb-a59e0bb69dd9', '686f4244-c9d4-43a9-9023-efc68734e19c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:23:53 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:23:53 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:23:53 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:23:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Deleted volume successfully. Aug 17 16:23:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b2a243d-b3c9-4e2a-80e0-2d2b967d73b4 tempest-VolumesTransfersV355Test-1566802661 None] Lock "cinder-9d1e35f0-ff6f-4229-bfab-3f26a244ef03-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:23:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7c3dbfa-7f50-4a23-a91d-0c5b13f55536 tempest-BackendsCapabilitiesAdminTestsJSON-1054803588 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864204406738, 'free_capacity_gb': 1775.6864204406738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 16:23:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3a05d23d-d5e8-48a5-a346-bcb6c353a268 tempest-BackendsCapabilitiesAdminTestsJSON-1054803588 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864204406738, 'free_capacity_gb': 1775.6864204406738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 16:24:03 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=122,cinder:DELETE=7,cinder:SELECT=82,cinder:INSERT=24 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:24:03 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=80,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=13 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Flow 'volume_create_manager' (0b07f732-16ac-46e7-ae29-4918f1646f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57547288-6652-4af8-8677-5f3cc8b637e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57547288-6652-4af8-8677-5f3cc8b637e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1950271263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334aca87-5a3d-49b3-96e8-2512b878c720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce07c521ee8459c876dd6b15b3d1324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:04Z,use_quota=True,user_id='96a60d8fe1d34d13ab84240dbb3b2b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80c3e05-7e7f-409b-8756-5094731130e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80c3e05-7e7f-409b-8756-5094731130e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f5d9a2-374c-4071-8913-42ab39a9ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f5d9a2-374c-4071-8913-42ab39a9ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334aca87-5a3d-49b3-96e8-2512b878c720', 'volume_name': 'volume-334aca87-5a3d-49b3-96e8-2512b878c720', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b21e69-2239-48f6-9234-9cdf1ca03309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b21e69-2239-48f6-9234-9cdf1ca03309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7c8440-1793-40d0-8a78-f98d4dc7ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Volume 334aca87-5a3d-49b3-96e8-2512b878c720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334aca87-5a3d-49b3-96e8-2512b878c720', 'volume_size': 1} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1950271263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334aca87-5a3d-49b3-96e8-2512b878c720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce07c521ee8459c876dd6b15b3d1324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:04Z,use_quota=True,user_id='96a60d8fe1d34d13ab84240dbb3b2b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Creating volume 334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:24:04 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:24:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:04 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 1073741824 Aug 17 16:24:04 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:05 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 1073741824" returned: 0 in 1.003s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:05 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:05 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:05 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.621s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:24:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7c8440-1793-40d0-8a78-f98d4dc7ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334aca87-5a3d-49b3-96e8-2512b878c720', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2581e0e8-3426-4d3a-9d44-b8473cea971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:06 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Volume volume-334aca87-5a3d-49b3-96e8-2512b878c720 (334aca87-5a3d-49b3-96e8-2512b878c720): created successfully Aug 17 16:24:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2581e0e8-3426-4d3a-9d44-b8473cea971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Flow 'volume_create_manager' (0b07f732-16ac-46e7-ae29-4918f1646f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-dea0cc00-9088-48c7-a06e-e12826ca2dbc tempest-VolumesCloneTest-193699934 None] Created volume successfully. Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Flow 'volume_create_manager' (7b8bf3fa-ae36-4c26-8cce-77db462aa3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b31a72d-3fd2-4b45-a130-15d63ce0ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b31a72d-3fd2-4b45-a130-15d63ce0ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1967600218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e2111b-e6d4-4208-8092-6cc625eb00a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d1a41d3eb940f7b7fcd9b1a358771c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:07Z,use_quota=True,user_id='3256c31a0dd0497786fce4b97cd3ab68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df531c3-9168-4633-8c93-b7a8b4a46a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df531c3-9168-4633-8c93-b7a8b4a46a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10a096d-123f-490e-9035-ee5b0e3ae7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10a096d-123f-490e-9035-ee5b0e3ae7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31e2111b-e6d4-4208-8092-6cc625eb00a4', 'volume_name': 'volume-31e2111b-e6d4-4208-8092-6cc625eb00a4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c7691-d269-45d4-93ad-ae1df32f79d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c7691-d269-45d4-93ad-ae1df32f79d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4204c3e9-4e20-4829-a931-fdbc3d0150e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:07 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Volume 31e2111b-e6d4-4208-8092-6cc625eb00a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31e2111b-e6d4-4208-8092-6cc625eb00a4', 'volume_size': 1} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1967600218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31e2111b-e6d4-4208-8092-6cc625eb00a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d1a41d3eb940f7b7fcd9b1a358771c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:07Z,use_quota=True,user_id='3256c31a0dd0497786fce4b97cd3ab68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Creating volume 31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:24:07 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:24:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:07 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 1073741824 Aug 17 16:24:07 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Flow 'volume_create_manager' (38ec7996-0581-41d5-a86e-27f9722ad2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db04612a-8907-48c4-ae1d-ffebb945cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db04612a-8907-48c4-ae1d-ffebb945cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1584989201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824ffccd-b1df-4f1d-9b0e-f15f94630d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bce07c521ee8459c876dd6b15b3d1324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=334aca87-5a3d-49b3-96e8-2512b878c720,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:08Z,use_quota=True,user_id='96a60d8fe1d34d13ab84240dbb3b2b24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d057bb-66e6-4f2a-8d77-aaefb7356e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d057bb-66e6-4f2a-8d77-aaefb7356e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6126d867-474f-42f6-b7e8-d33be192193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6126d867-474f-42f6-b7e8-d33be192193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '824ffccd-b1df-4f1d-9b0e-f15f94630d1e', 'volume_name': 'volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e', 'volume_size': 2, 'source_volid': '334aca87-5a3d-49b3-96e8-2512b878c720', 'source_volstatus': 'available'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a00683a-2939-464a-8acb-83c99754e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a00683a-2939-464a-8acb-83c99754e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda48504-3b25-4ec3-be62-fbc4b9e4b7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Volume 824ffccd-b1df-4f1d-9b0e-f15f94630d1e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e', 'volume_size': 2, 'source_volid': '334aca87-5a3d-49b3-96e8-2512b878c720', 'source_volstatus': 'available'} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:08 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 1073741824" returned: 0 in 0.779s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:08 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:24:08 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-f263ad5f-f728-4333-af91-91416aae2542 req-0b5def78-2edb-401c-9cc3-6d2e67aaa91e tempest-AttachVolumeTestJSON-1096176667 None] Terminate volume connection completed successfully. Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-f263ad5f-f728-4333-af91-91416aae2542 req-0b5def78-2edb-401c-9cc3-6d2e67aaa91e tempest-AttachVolumeTestJSON-1096176667 None] Deleting attachment 46089c8c-fe2b-47fb-8923-a33b50ae9d97. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:24:08 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.330s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.417s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:08 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Cloning volume 334aca87-5a3d-49b3-96e8-2512b878c720 to volume 824ffccd-b1df-4f1d-9b0e-f15f94630d1e Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4204c3e9-4e20-4829-a931-fdbc3d0150e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31e2111b-e6d4-4208-8092-6cc625eb00a4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea057be6-1aad-44f0-a538-3c3439b5b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Volume volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 (31e2111b-e6d4-4208-8092-6cc625eb00a4): created successfully Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea057be6-1aad-44f0-a538-3c3439b5b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Flow 'volume_create_manager' (7b8bf3fa-ae36-4c26-8cce-77db462aa3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1698bff8-f7f4-4e34-bd4b-6ac64a5ba32d tempest-VolumesActionsTest-352994462 None] Created volume successfully. Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Creating offline snapshot ddf33985-1c94-4b64-a196-e0ae85c51829 of volume 334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce9bbc-3540-4e91-a740-313cf0653682]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:09 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:09 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:09 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.595s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:09 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 1G Aug 17 16:24:09 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:10 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 1G" returned: 0 in 0.614s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aca87-5a3d-49b3-96e8-2512b878c720 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:10 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aca87-5a3d-49b3-96e8-2512b878c720 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:10 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:10 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-334aca87-5a3d-49b3-96e8-2512b878c720 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 0.393s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:10 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 is being set with open permissions: ugo+rw Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:10 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:10 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:10 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:10 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info Aug 17 16:24:10 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:11 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:11 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info is being set with open permissions: ugo+rw Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:11 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info Aug 17 16:24:11 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:11 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.info" returned: 0 in 0.523s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] snapshot: ddf33985-1c94-4b64-a196-e0ae85c51829, volume: 824ffccd-b1df-4f1d-9b0e-f15f94630d1e, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd5ef2-861f-4b24-8f80-5a466e5c03fc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:12 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:12 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:12 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 0.722s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334aca87-5a3d-49b3-96e8-2512b878c720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[49febc5f-5368-4f0e-8a46-dd373c9d0f51]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:13 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:13 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:13 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.937s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:24:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:24:13 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:24:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:13 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e Aug 17 16:24:13 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:20 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:24:20 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:24:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" returned: 0 in 8.710s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:22 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720, size 1024.00 MB, duration 8.71 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:24:22 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Converted 1024.00 MB image at 117.56 MB/s Aug 17 16:24:22 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e is being set with open permissions: ugo+rw Aug 17 16:24:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:22 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e Aug 17 16:24:22 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:23 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" returned: 0 in 0.747s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" released by "_copy_volume_from_snapshot" :: held 11.253s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-quobyte-ddf33985-1c94-4b64-a196-e0ae85c51829" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-ddf33985-1c94-4b64-a196-e0ae85c51829" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Deleting offline snapshot ddf33985-1c94-4b64-a196-e0ae85c51829 of volume 334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] snapshot_file for this snap is: volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300a792-0b37-428f-bedf-6cc1a2243a7b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:23 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:23 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:24 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 1.053s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-334aca87-5a3d-49b3-96e8-2512b878c720(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:24:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[242fd3ab-db5a-49d6-a332-2e30adbb0b50]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:24 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:24 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:25 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.895s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:25 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:25 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:26 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 0.538s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:26 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829 Aug 17 16:24:26 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:26 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720.ddf33985-1c94-4b64-a196-e0ae85c51829" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-ddf33985-1c94-4b64-a196-e0ae85c51829" released by "_delete_snapshot" :: held 3.177s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.918s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda48504-3b25-4ec3-be62-fbc4b9e4b7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e', 'volume_size': 2, 'source_volid': '334aca87-5a3d-49b3-96e8-2512b878c720', 'source_volstatus': 'available'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a9e760-4bbd-489f-878a-80e44d597d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Volume volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e (824ffccd-b1df-4f1d-9b0e-f15f94630d1e): created successfully Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a9e760-4bbd-489f-878a-80e44d597d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Flow 'volume_create_manager' (38ec7996-0581-41d5-a86e-27f9722ad2de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a3140e2f-ca12-45cf-94ff-cd893f870e35 tempest-VolumesCloneTest-193699934 None] Created volume successfully. Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-824ffccd-b1df-4f1d-9b0e-f15f94630d1e-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "cinder-824ffccd-b1df-4f1d-9b0e-f15f94630d1e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" acquired by "delete_volume" :: waited 0.054s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8bb35d-baa1-4646-8f0d-44cd62231b89]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:28 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e Aug 17 16:24:28 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9619559-64e0-4e2c-8466-87a6fed0d6e6 tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" by "attach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9619559-64e0-4e2c-8466-87a6fed0d6e6 tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" acquired by "attach_volume" :: waited 0.045s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d9619559-64e0-4e2c-8466-87a6fed0d6e6 tempest-VolumesActionsTest-352994462 None] Attaching volume 31e2111b-e6d4-4208-8092-6cc625eb00a4 to instance 682a92e8-526b-48b1-ad7f-c4ee3c0ac74d at mountpoint /dev/vdb on host None. Aug 17 16:24:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d9619559-64e0-4e2c-8466-87a6fed0d6e6 tempest-VolumesActionsTest-352994462 None] Attach volume completed successfully. Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d9619559-64e0-4e2c-8466-87a6fed0d6e6 tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" released by "attach_volume" :: held 0.259s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:28 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" returned: 0 in 0.875s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:28 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b9784f9-97b3-4df1-a212-fd4f195688aa tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" by "detach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:28 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b9784f9-97b3-4df1-a212-fd4f195688aa tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" acquired by "detach_volume" :: waited 0.079s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5b9784f9-97b3-4df1-a212-fd4f195688aa tempest-VolumesActionsTest-352994462 None] Detaching volume 31e2111b-e6d4-4208-8092-6cc625eb00a4 from instance 682a92e8-526b-48b1-ad7f-c4ee3c0ac74d. Aug 17 16:24:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5b9784f9-97b3-4df1-a212-fd4f195688aa tempest-VolumesActionsTest-352994462 None] Detach volume completed successfully. Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5b9784f9-97b3-4df1-a212-fd4f195688aa tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:29 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" returned: 0 in 0.661s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-824ffccd-b1df-4f1d-9b0e-f15f94630d1e" released by "delete_volume" :: held 1.646s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Created reservations ['ae2f7043-92e2-493e-9873-ea104da86d85', 'fe6ead10-06d8-4e1a-b0b4-ecd04b64bade', 'ad047e6a-ebc5-406f-b414-2e714126aac6', '22c8591a-e1a1-4ace-b841-2a71b1aba96c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:29 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:24:29 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:30 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.501s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:24:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Deleted volume successfully. Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ef798c66-7f09-420c-9e55-3b4730d9e9cb tempest-VolumesCloneTest-193699934 None] Lock "cinder-824ffccd-b1df-4f1d-9b0e-f15f94630d1e-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-334aca87-5a3d-49b3-96e8-2512b878c720-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "cinder-334aca87-5a3d-49b3-96e8-2512b878c720-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Acquiring lock "cinder-quobyte-334aca87-5a3d-49b3-96e8-2512b878c720" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-334aca87-5a3d-49b3-96e8-2512b878c720" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac1bf0d-78f0-472f-a186-370c7fa94f62]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:31 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:31 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:31 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.801s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:31 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720 Aug 17 16:24:31 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:32 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-334aca87-5a3d-49b3-96e8-2512b878c720" returned: 0 in 0.819s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "cinder-quobyte-334aca87-5a3d-49b3-96e8-2512b878c720" released by "delete_volume" :: held 1.904s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Created reservations ['06d68aec-8c32-4073-b502-a54f05aae00e', 'd74646a9-5cad-480e-9052-d02f0efd759b', '8a989794-fe56-4fd9-8c98-5317e8b94b53', '87bb56d5-bc81-4b5e-85ab-1b8cd9909ab4'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:32 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:24:32 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:33 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.578s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:33 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:24:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Deleted volume successfully. Aug 17 16:24:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2a9065cd-1b3f-4c1c-beea-17039faf5af7 tempest-VolumesCloneTest-193699934 None] Lock "cinder-334aca87-5a3d-49b3-96e8-2512b878c720-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Flow 'volume_create_manager' (46ff792b-51bf-432f-9bef-9ff4ab95c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1334dbb4-57b6-4bce-8d0f-61ef2d3cef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1334dbb4-57b6-4bce-8d0f-61ef2d3cef35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-463493429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd318a7-3d62-4f39-aeb1-502542c13cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377926bebbca405c81a33b20a39a0e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:38Z,use_quota=True,user_id='2a2629860634446583e863527e637fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4e26ae-4679-414a-8208-eacb434e29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4e26ae-4679-414a-8208-eacb434e29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26034c20-d6ff-4441-8fbb-81dcc114dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26034c20-d6ff-4441-8fbb-81dcc114dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fd318a7-3d62-4f39-aeb1-502542c13cfd', 'volume_name': 'volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd', 'volume_size': 2}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af903c10-a404-41cb-a983-73100837032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af903c10-a404-41cb-a983-73100837032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ff42c2-6eb6-4118-8553-3344179127ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Volume 4fd318a7-3d62-4f39-aeb1-502542c13cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd', 'volume_size': 2} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-463493429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd318a7-3d62-4f39-aeb1-502542c13cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377926bebbca405c81a33b20a39a0e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:38Z,use_quota=True,user_id='2a2629860634446583e863527e637fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Creating volume 4fd318a7-3d62-4f39-aeb1-502542c13cfd {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:24:38 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd 2147483648 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:38 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd 2147483648 Aug 17 16:24:38 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Flow 'volume_create_manager' (ec925d6d-38af-42f0-9e77-981522b8871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b27ca-2256-447e-bb90-b65f9306a647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b27ca-2256-447e-bb90-b65f9306a647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1805042529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fce0b55-348d-49b9-a495-097892d1978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f18b4f924d3460b94fadd7966d7392c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:38Z,use_quota=True,user_id='6b0757deffa34d8687ae174247c43ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc71ed-8f80-4ed8-af32-46d8ec3931f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fc71ed-8f80-4ed8-af32-46d8ec3931f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6de13e-9f19-4301-91a6-3f467a1bd263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6de13e-9f19-4301-91a6-3f467a1bd263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fce0b55-348d-49b9-a495-097892d1978d', 'volume_name': 'volume-0fce0b55-348d-49b9-a495-097892d1978d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f51b67-8db6-4dd4-9544-74a087a52d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f51b67-8db6-4dd4-9544-74a087a52d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef9a1b6-96f9-44a6-9773-b4d7becfbf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Volume 0fce0b55-348d-49b9-a495-097892d1978d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fce0b55-348d-49b9-a495-097892d1978d', 'volume_size': 1} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:38 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd 2147483648" returned: 0 in 0.650s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:38 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd Aug 17 16:24:38 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:39 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1805042529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fce0b55-348d-49b9-a495-097892d1978d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f18b4f924d3460b94fadd7966d7392c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:38Z,use_quota=True,user_id='6b0757deffa34d8687ae174247c43ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Creating volume 0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:24:39 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ff42c2-6eb6-4118-8553-3344179127ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd', 'volume_size': 2}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:39 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d 1073741824 Aug 17 16:24:39 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d795a4b-67d3-4fd9-acc7-c4dad2e80ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Volume volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd (4fd318a7-3d62-4f39-aeb1-502542c13cfd): created successfully Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d795a4b-67d3-4fd9-acc7-c4dad2e80ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Flow 'volume_create_manager' (46ff792b-51bf-432f-9bef-9ff4ab95c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3e5729db-5651-42b8-9963-021300d7b76d tempest-VolumesCloneNegativeTest-1965642303 None] Created volume successfully. Aug 17 16:24:39 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d 1073741824" returned: 0 in 0.529s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:39 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d Aug 17 16:24:39 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:39 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d" returned: 0 in 0.301s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef9a1b6-96f9-44a6-9773-b4d7becfbf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fce0b55-348d-49b9-a495-097892d1978d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f359d733-299b-4b29-85eb-061bba53e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Volume volume-0fce0b55-348d-49b9-a495-097892d1978d (0fce0b55-348d-49b9-a495-097892d1978d): created successfully Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f359d733-299b-4b29-85eb-061bba53e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Flow 'volume_create_manager' (ec925d6d-38af-42f0-9e77-981522b8871d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9f369a50-7b85-46b1-a9f1-e85ac24da118 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Created volume successfully. Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Acquiring lock "cinder-4fd318a7-3d62-4f39-aeb1-502542c13cfd-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "cinder-4fd318a7-3d62-4f39-aeb1-502542c13cfd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Acquiring lock "cinder-quobyte-4fd318a7-3d62-4f39-aeb1-502542c13cfd" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "cinder-quobyte-4fd318a7-3d62-4f39-aeb1-502542c13cfd" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[480eebd2-da5f-4715-aeee-80018ae9b500]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:41 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd Aug 17 16:24:41 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Creating offline snapshot f9f75393-4f92-4596-89ed-5ac7a65bd865 of volume 0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:24:41 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d088a4-10ec-4a07-bdbf-1a68f680e5ac]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:41 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d Aug 17 16:24:41 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:42 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd" returned: 0 in 1.316s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:42 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd Aug 17 16:24:42 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:42 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d" returned: 0 in 0.830s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:42 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 1G Aug 17 16:24:42 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:42 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd318a7-3d62-4f39-aeb1-502542c13cfd" returned: 0 in 0.469s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "cinder-quobyte-4fd318a7-3d62-4f39-aeb1-502542c13cfd" released by "delete_volume" :: held 1.903s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Created reservations ['58e461dd-668a-402c-885d-67c0833680dd', '3dfa6fb5-ca01-4668-9b38-b81551ce3af6', '1cf29cbd-e672-412b-bac0-5c032b9f518d', 'c9f2dbed-7166-45ae-bfae-0698950bcca3'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:43 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:24:43 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:43 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 1G" returned: 0 in 0.759s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fce0b55-348d-49b9-a495-097892d1978d -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:43 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fce0b55-348d-49b9-a495-097892d1978d -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 Aug 17 16:24:43 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:43 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:24:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Deleted volume successfully. Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aa9fbc4e-5bb9-433d-9b37-31585e6321c5 tempest-VolumesCloneNegativeTest-1965642303 None] Lock "cinder-4fd318a7-3d62-4f39-aeb1-502542c13cfd-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:43 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fce0b55-348d-49b9-a495-097892d1978d -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865" returned: 0 in 0.751s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:43 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 is being set with open permissions: ugo+rw Aug 17 16:24:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:43 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 Aug 17 16:24:43 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:44 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:44 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info Aug 17 16:24:44 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:45 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info" returned: 0 in 0.590s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info is being set with open permissions: ugo+rw Aug 17 16:24:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:45 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info Aug 17 16:24:45 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:45 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.info" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.041s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-dffe3124-cfec-4d1f-b883-9681d79ed5f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Create snapshot completed successfully Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "cinder-f9f75393-4f92-4596-89ed-5ac7a65bd865-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:46 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:24:46 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-f9f75393-4f92-4596-89ed-5ac7a65bd865-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "cinder-quobyte-f9f75393-4f92-4596-89ed-5ac7a65bd865" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-f9f75393-4f92-4596-89ed-5ac7a65bd865" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Deleting offline snapshot f9f75393-4f92-4596-89ed-5ac7a65bd865 of volume 0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] snapshot_file for this snap is: volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef23c78a-8c5f-4f33-8057-9670d910fd77]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-58355313-d575-4716-997d-e25c4c2aa7e7 tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" by "attach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-58355313-d575-4716-997d-e25c4c2aa7e7 tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" acquired by "attach_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:47 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 Aug 17 16:24:47 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-58355313-d575-4716-997d-e25c4c2aa7e7 tempest-VolumesActionsTest-352994462 None] Attaching volume 31e2111b-e6d4-4208-8092-6cc625eb00a4 to instance 838e1b34-6875-46e1-ae9c-13472e269c72 at mountpoint /dev/vdb on host None. Aug 17 16:24:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-58355313-d575-4716-997d-e25c4c2aa7e7 tempest-VolumesActionsTest-352994462 None] Attach volume completed successfully. Aug 17 16:24:47 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.765s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-58355313-d575-4716-997d-e25c4c2aa7e7 tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4" released by "attach_volume" :: held 0.336s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 28 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:24:47 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865" returned: 0 in 0.808s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fce0b55-348d-49b9-a495-097892d1978d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ff4f15-bddb-49f9-9b11-624e81531141]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-61d1901b-8e37-441c-9f75-c6686997792a tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" by "detach_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-61d1901b-8e37-441c-9f75-c6686997792a tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-61d1901b-8e37-441c-9f75-c6686997792a tempest-VolumesActionsTest-352994462 None] Detaching volume 31e2111b-e6d4-4208-8092-6cc625eb00a4 from instance 838e1b34-6875-46e1-ae9c-13472e269c72. Aug 17 16:24:48 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d Aug 17 16:24:48 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-61d1901b-8e37-441c-9f75-c6686997792a tempest-VolumesActionsTest-352994462 None] Detach volume completed successfully. Aug 17 16:24:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-61d1901b-8e37-441c-9f75-c6686997792a tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-detach_volume" released by "detach_volume" :: held 0.190s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:49 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d" returned: 0 in 1.167s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:49 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 Aug 17 16:24:49 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:49 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865" returned: 0 in 0.810s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:49 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865 Aug 17 16:24:49 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:50 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d.f9f75393-4f92-4596-89ed-5ac7a65bd865" returned: 0 in 0.439s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-f9f75393-4f92-4596-89ed-5ac7a65bd865" released by "_delete_snapshot" :: held 3.481s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" released by "delete_snapshot" :: held 3.518s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Created reservations ['e4fd1ac4-152b-4444-b905-c4399ebdfa19', '04ee14fc-8a86-4b5a-897b-b7d0b5fd254f', 'f2967288-d511-4eac-82d4-ce21a6a83c76', 'd09a45de-5c63-4345-b807-d3cd369f079b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:24:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Delete snapshot completed successfully. Aug 17 16:24:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1a51f678-3d65-40f5-816b-2e0d0273fd0b tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-f9f75393-4f92-4596-89ed-5ac7a65bd865-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Flow 'volume_create_manager' (286361e9-b71c-402a-920c-650249268ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6299bf5b-eb56-45cc-8e63-e1ca2932cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6299bf5b-eb56-45cc-8e63-e1ca2932cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1629278588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5ecb31-ace8-4a4c-9a89-0ed98016d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66a50b7b79a468c90a775cef9109a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:51Z,use_quota=True,user_id='5153ddd74a2d4d6cb3f0510c98453ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858cdd1c-bd51-485a-95de-1b0df7ab999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858cdd1c-bd51-485a-95de-1b0df7ab999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9673410-b745-420c-809b-57c3eba59ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "cinder-0fce0b55-348d-49b9-a495-097892d1978d-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-0fce0b55-348d-49b9-a495-097892d1978d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" acquired by "delete_volume" :: waited 0.045s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9673410-b745-420c-809b-57c3eba59ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd5ecb31-ace8-4a4c-9a89-0ed98016d10c', 'volume_name': 'volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02723e8-d577-49be-8551-5a267ba2ba85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02723e8-d577-49be-8551-5a267ba2ba85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7a7c04-9414-49c8-aa2d-b6abe735a6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:24:51 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Trying to clone fd5ecb31-ace8-4a4c-9a89-0ed98016d10c from image 9d40602e-5637-4537-aeab-5c295ac7c705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[980595b4-e6e3-4622-9054-7c9895fc5414]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:51 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d Aug 17 16:24:51 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:24:52 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Image download 20.69 MB at 20.69 MB/s Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf14803-b7cc-4002-ba96-27316c889b23]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:52 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d" returned: 0 in 0.701s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:52 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d Aug 17 16:24:52 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:52 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD Aug 17 16:24:52 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:52 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fce0b55-348d-49b9-a495-097892d1978d" returned: 0 in 0.378s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-quobyte-0fce0b55-348d-49b9-a495-097892d1978d" released by "delete_volume" :: held 1.196s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Created reservations ['3bdd1728-b499-4b46-9c9f-fe891ef5129c', 'd410babe-4ba0-4976-ade8-d31527e5aacd', 'c2c6c452-1371-4e2f-984e-c22a8265777c', 'eb29c0c6-d586-40ce-9ea3-f87b3705b89e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:24:52 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:52 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 is fetched for user 5153ddd74a2d4d6cb3f0510c98453ebf. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1309b9fd-a054-4781-a3c0-7ee539599ec9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:53 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:24:53 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:53 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD Aug 17 16:24:53 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:53 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.346s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:24:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Deleted volume successfully. Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c93b3b9-0023-4e17-85f3-2c476cc00cdc tempest-VolumeSnapshotQuotasNegativeTestJSON-1281747860 None] Lock "cinder-0fce0b55-348d-49b9-a495-097892d1978d-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:24:53 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1629278588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5ecb31-ace8-4a4c-9a89-0ed98016d10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66a50b7b79a468c90a775cef9109a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:24:51Z,use_quota=True,user_id='5153ddd74a2d4d6cb3f0510c98453ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Creating volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:24:53 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:24:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:53 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1073741824 Aug 17 16:24:53 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:54 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1073741824" returned: 0 in 0.702s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:54 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c Aug 17 16:24:54 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:54 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" returned: 0 in 0.321s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Attempting download of 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a318d7-7652-4b31-85ad-f9cce4745464]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:55 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd Aug 17 16:24:55 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7824061d-5f22-4e48-9570-107b7ac5d419]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:55 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:24:55 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:55 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd" returned: 0 in 0.499s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:55 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd Aug 17 16:24:55 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:55 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.533s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a7e835-75b0-43b6-a9b2-6edeb65ab63e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:55 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd" returned: 1 in 0.482s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_6sxbjepd' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2333e-5a17-4160-9b74-4bb5405d1071]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:24:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:55 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:24:55 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:55 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD Aug 17 16:24:55 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:56 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.573s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.ad028668-27e4-4752-9867-10be6583c2ecr9qha8cz.img {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:56 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.ad028668-27e4-4752-9867-10be6583c2ecr9qha8cz.img Aug 17 16:24:56 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:24:56 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Aug 17 16:24:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:24:56 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] 9d40602e-5637-4537-aeab-5c295ac7c705 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:24:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:24:56 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c Aug 17 16:24:56 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:00 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" returned: 0 in 4.598s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:00 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vd_adxfydevstack@QuobyteHD, size 112.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:25:00 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Converted 112.00 MB image at 24.32 MB/s Aug 17 16:25:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:01 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1G Aug 17 16:25:01 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:02 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 1G" returned: 0 in 1.393s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Downloaded image 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 for user 5153ddd74a2d4d6cb3f0510c98453ebf is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Marking volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Copying metadata from image 9d40602e-5637-4537-aeab-5c295ac7c705 to fd5ecb31-ace8-4a4c-9a89-0ed98016d10c. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Creating volume glance metadata for volume fd5ecb31-ace8-4a4c-9a89-0ed98016d10c backed by image 9d40602e-5637-4537-aeab-5c295ac7c705 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7a7c04-9414-49c8-aa2d-b6abe735a6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca7228e-0bb4-493a-851c-f08580224e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:02 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Volume volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c (fd5ecb31-ace8-4a4c-9a89-0ed98016d10c): created successfully Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ca7228e-0bb4-493a-851c-f08580224e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Flow 'volume_create_manager' (286361e9-b71c-402a-920c-650249268ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ad2fd200-d5d7-4893-8299-cc287c497654 tempest-VolumesExtendTest-441234656 None] Created volume successfully. Aug 17 16:25:03 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.ad028668-27e4-4752-9867-10be6583c2ecr9qha8cz.img" returned: 0 in 7.162s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef16622-d531-47c5-96ac-effccffeaa45]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:03 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:03 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:04 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.716s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.ad028668-27e4-4752-9867-10be6583c2ecr9qha8cz.img {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:25:04 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Converted 1024.00 MB image at 142.94 MB/s Aug 17 16:25:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] ad028668-27e4-4752-9867-10be6583c2ec was raw, no need to convert to raw {{(pid=94468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 17 16:25:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Flow 'volume_create_manager' (c5c03d21-f74d-4f0b-a3fa-5ed3c65b6bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45781d6f-f28d-4e95-b12d-6ba97e2d6624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45781d6f-f28d-4e95-b12d-6ba97e2d6624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1243211704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4d8465-6474-40f4-9c1f-095851f99446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef352379d72640ddbcc31232c3da72c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:08Z,use_quota=True,user_id='0fd3649ac2c5423f8dd7b4c9ebc3bf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c8af3a6-80ae-4284-b612-1f9946eaf38b),volume_type_id=5c8af3a6-80ae-4284-b612-1f9946eaf38b)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182da0b8-4e5b-48f4-92cb-820fb2aec28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182da0b8-4e5b-48f4-92cb-820fb2aec28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8c0761-2125-462a-8398-5dbf683889a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8c0761-2125-462a-8398-5dbf683889a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4d8465-6474-40f4-9c1f-095851f99446', 'volume_name': 'volume-be4d8465-6474-40f4-9c1f-095851f99446', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d93ebc-8c33-4ed5-b2cb-dd1b0530ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d93ebc-8c33-4ed5-b2cb-dd1b0530ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4d6d3-f09b-4c7d-b773-188698bbd3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Volume be4d8465-6474-40f4-9c1f-095851f99446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4d8465-6474-40f4-9c1f-095851f99446', 'volume_size': 1} Aug 17 16:25:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:14 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=51,cinder:SELECT=66,cinder:DELETE=8,cinder:INSERT=21 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:25:18 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=69,cinder:INSERT=21,cinder:SELECT=53,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:25:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.539s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Uploaded volume to glance image-id: ad028668-27e4-4752-9867-10be6583c2ec. {{(pid=94468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 16:25:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 24.367s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:28 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d4e1f-2954-46fa-94b3-0075c516c671]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8d3d1193-d619-41dd-8573-77a9ec0d5777 tempest-VolumesActionsTest-352994462 None] Copy volume to image completed successfully. Aug 17 16:25:28 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c Aug 17 16:25:28 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:29 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" returned: 0 in 0.424s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 2G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c 2G" returned: 0 in 0.132s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.581s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.697s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1243211704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4d8465-6474-40f4-9c1f-095851f99446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef352379d72640ddbcc31232c3da72c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:08Z,use_quota=True,user_id='0fd3649ac2c5423f8dd7b4c9ebc3bf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c8af3a6-80ae-4284-b612-1f9946eaf38b),volume_type_id=5c8af3a6-80ae-4284-b612-1f9946eaf38b)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Creating volume be4d8465-6474-40f4-9c1f-095851f99446 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:29 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:29 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 1073741824 Aug 17 16:25:29 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c2b70221-9d82-4e48-b31b-f210e4fcdd17 tempest-VolumesExtendTest-441234656 None] Extend volume completed successfully. Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "cinder-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-quobyte-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:29 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 1073741824" returned: 0 in 0.734s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f7ee9-8c2b-46dc-9228-877ef3afc008]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:30 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 Aug 17 16:25:30 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:30 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c Aug 17 16:25:30 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:30 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446" returned: 0 in 0.352s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd4d6d3-f09b-4c7d-b773-188698bbd3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4d8465-6474-40f4-9c1f-095851f99446', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040f69d5-bdce-4e8e-9444-9049da58c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:30 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Volume volume-be4d8465-6474-40f4-9c1f-095851f99446 (be4d8465-6474-40f4-9c1f-095851f99446): created successfully Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040f69d5-bdce-4e8e-9444-9049da58c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Flow 'volume_create_manager' (c5c03d21-f74d-4f0b-a3fa-5ed3c65b6bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-332c2602-476e-489c-8376-5e3979f40492 tempest-VolumeTypesAccessTest-923801832 None] Created volume successfully. Aug 17 16:25:30 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" returned: 0 in 0.537s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:30 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c Aug 17 16:25:30 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d86af01-a333-4a81-b73b-2702ffa1e2ba]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:30 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:30 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:30 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c" released by "delete_volume" :: held 0.925s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Created reservations ['16c050b4-f8ea-4885-948b-74773dbb5271', '727446fa-d26c-4dc6-bc91-4750ec7cff8e', '964fd15e-6850-4dd9-979e-39d073078d5a', '4d9758d0-cf8d-4919-8f9c-32c8ec7a131a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:31 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:25:31 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:31 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.480s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[36261de7-960a-409f-adbe-2eae96f1a334]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:31 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:31 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:31 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:25:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Deleted volume successfully. Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2bc10bca-76cf-4ce5-bcc3-90f6ff02b469 tempest-VolumesExtendTest-441234656 None] Lock "cinder-fd5ecb31-ace8-4a4c-9a89-0ed98016d10c-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Acquiring lock "cinder-be4d8465-6474-40f4-9c1f-095851f99446-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "cinder-be4d8465-6474-40f4-9c1f-095851f99446-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Acquiring lock "cinder-quobyte-be4d8465-6474-40f4-9c1f-095851f99446" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "cinder-quobyte-be4d8465-6474-40f4-9c1f-095851f99446" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f6a27d-dd25-49e2-8b66-75074d7c9ee6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:31 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.609s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:31 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img Aug 17 16:25:31 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:31 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 Aug 17 16:25:31 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Flow 'volume_create_manager' (1325f9d7-84aa-4843-b4a3-5d2d63033d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76876c20-a428-4ecb-88ce-332e16550cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76876c20-a428-4ecb-88ce-332e16550cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1959563880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dee602e-d456-4a5b-9505-d0f8b02fff29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66a50b7b79a468c90a775cef9109a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:32Z,use_quota=True,user_id='5153ddd74a2d4d6cb3f0510c98453ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb1d5d3-9857-4f16-90c4-343501142645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb1d5d3-9857-4f16-90c4-343501142645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c4a0c7-5660-4438-bb1a-514b1ebfc696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c4a0c7-5660-4438-bb1a-514b1ebfc696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dee602e-d456-4a5b-9505-d0f8b02fff29', 'volume_name': 'volume-6dee602e-d456-4a5b-9505-d0f8b02fff29', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346148d-7281-4d13-82c6-d55203885613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c346148d-7281-4d13-82c6-d55203885613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6352a245-5a10-45bc-be4f-495b14398e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Volume 6dee602e-d456-4a5b-9505-d0f8b02fff29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dee602e-d456-4a5b-9505-d0f8b02fff29', 'volume_size': 1} Aug 17 16:25:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:32 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446" returned: 0 in 0.541s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:32 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446 Aug 17 16:25:32 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:33 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-be4d8465-6474-40f4-9c1f-095851f99446" returned: 0 in 0.859s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "cinder-quobyte-be4d8465-6474-40f4-9c1f-095851f99446" released by "delete_volume" :: held 1.495s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:33 devstack cinder-volume[94468]: WARNING cinder.quota [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1866326849 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1866326849, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:25:33 devstack cinder-volume[94468]: WARNING cinder.quota [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1866326849 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1866326849, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Created reservations ['d8668517-17d9-4ff7-96c2-21a3597d794f', '408d4866-bd07-4de4-8863-5b9bea2576c2', '52a6c298-1633-44ac-8d89-b50faead9344', 'ad252017-6225-4338-bdd3-ec3c60396717'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:33 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:25:33 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:34 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.908s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:34 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:25:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Deleted volume successfully. Aug 17 16:25:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5295942f-ec20-4c3a-bc1c-1497725c9b01 tempest-VolumeTypesAccessTest-923801832 None] Lock "cinder-be4d8465-6474-40f4-9c1f-095851f99446-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (2b8a828b-f94c-41b3-b48a-664ff09a13de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced23dd2-3b5c-4517-b004-62db6ba6b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced23dd2-3b5c-4517-b004-62db6ba6b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1592531707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c595023-4821-499a-a7ab-b701c4fd4cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:36Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239c4e4-be67-4369-b0d8-6ef33e407464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f239c4e4-be67-4369-b0d8-6ef33e407464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f8834e-93c1-4d57-9f0a-cff915bf43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f8834e-93c1-4d57-9f0a-cff915bf43c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c595023-4821-499a-a7ab-b701c4fd4cb3', 'volume_name': 'volume-1c595023-4821-499a-a7ab-b701c4fd4cb3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302f6506-36b1-4e78-9c26-31e75089f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302f6506-36b1-4e78-9c26-31e75089f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7391e2-1c12-46c5-9757-55c0310ed2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:36 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Volume 1c595023-4821-499a-a7ab-b701c4fd4cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c595023-4821-499a-a7ab-b701c4fd4cb3', 'volume_size': 1} Aug 17 16:25:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:37 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img" returned: 0 in 5.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873b8a9-3745-42e3-ad4d-4fd1f74abf7d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:37 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:37 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:37 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.581s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:25:37 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Converted 1024.00 MB image at 193.62 MB/s Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] 75382760-cd52-46ea-bff3-602c53d4f4a8 was raw, converting to qcow2 {{(pid=94468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c787e980-7917-4257-9525-7b03193b0384]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:37 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img Aug 17 16:25:37 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:38 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:38 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img Aug 17 16:25:38 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:38 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img" returned: 1 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img /opt/stack/data/cinder/conversion/vol_upload_sha_k8be {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:38 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img /opt/stack/data/cinder/conversion/vol_upload_sha_k8be Aug 17 16:25:38 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:38 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img /opt/stack/data/cinder/conversion/vol_upload_sha_k8be" returned: 0 in 0.323s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Image conversion details: src /opt/stack/data/cinder/conversion/31e2111b-e6d4-4208-8092-6cc625eb00a4.temp_image.75382760-cd52-46ea-bff3-602c53d4f4a80i85wrbd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sha_k8be {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:25:38 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f670e21-5117-4571-a164-5d2e5efb840d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sha_k8be {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:38 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sha_k8be Aug 17 16:25:38 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:39 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sha_k8be" returned: 0 in 0.387s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.802s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Uploaded volume to glance image-id: 75382760-cd52-46ea-bff3-602c53d4f4a8. {{(pid=94468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.397s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1959563880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dee602e-d456-4a5b-9505-d0f8b02fff29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66a50b7b79a468c90a775cef9109a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:32Z,use_quota=True,user_id='5153ddd74a2d4d6cb3f0510c98453ebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Creating volume 6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:41 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:41 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 1073741824 Aug 17 16:25:41 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3f4ad0b4-7831-47a5-a2ca-d90b4b420472 tempest-VolumesActionsTest-352994462 None] Copy volume to image completed successfully. Aug 17 16:25:41 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 1073741824" returned: 0 in 0.527s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:42 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:42 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:42 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.234s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1592531707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c595023-4821-499a-a7ab-b701c4fd4cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:36Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Creating volume 1c595023-4821-499a-a7ab-b701c4fd4cb3 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:42 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6352a245-5a10-45bc-be4f-495b14398e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dee602e-d456-4a5b-9505-d0f8b02fff29', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:42 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 1073741824 Aug 17 16:25:42 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d02520-9404-4f7b-bb43-e9e711bec695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Volume volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 (6dee602e-d456-4a5b-9505-d0f8b02fff29): created successfully Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d02520-9404-4f7b-bb43-e9e711bec695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Flow 'volume_create_manager' (1325f9d7-84aa-4843-b4a3-5d2d63033d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4b2196ec-ee7b-4ddf-a953-848bf730339f tempest-VolumesExtendTest-441234656 None] Created volume successfully. Aug 17 16:25:42 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 1073741824" returned: 0 in 0.549s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:42 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 Aug 17 16:25:42 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:43 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d7391e2-1c12-46c5-9757-55c0310ed2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c595023-4821-499a-a7ab-b701c4fd4cb3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64457d2-f06f-4973-89b6-7dd7ef5ba8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:43 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Volume volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 (1c595023-4821-499a-a7ab-b701c4fd4cb3): created successfully Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64457d2-f06f-4973-89b6-7dd7ef5ba8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (2b8a828b-f94c-41b3-b48a-664ff09a13de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Acquiring lock "cinder-quobyte-31e2111b-e6d4-4208-8092-6cc625eb00a4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-fb34d3a1-5753-4d6f-9972-d8f42fddc3c3 tempest-AttachVolumeTestJSON-1096176667 None] Created volume successfully. Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Creating offline snapshot 3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 of volume 6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "cinder-quobyte-31e2111b-e6d4-4208-8092-6cc625eb00a4" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0e9752-0f7d-4859-8718-000f3d9d6703]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d7df5-83e8-4d71-8793-9d9fc57dfe4d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:43 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:43 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:43 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:43 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:43 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.461s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:43 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.457s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:43 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 1G Aug 17 16:25:43 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:44 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4 Aug 17 16:25:44 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:44 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31e2111b-e6d4-4208-8092-6cc625eb00a4" returned: 0 in 0.307s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "cinder-quobyte-31e2111b-e6d4-4208-8092-6cc625eb00a4" released by "delete_volume" :: held 0.821s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Created reservations ['f31e2e13-26ff-4c1c-a9de-8cc3e2d9cb89', '50175ace-2adf-46f6-9af7-30cffc9e216f', '177835de-5493-454e-be83-c79f83c41a40', '403543ad-4ca9-4443-9295-565b354ba43e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:44 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:25:44 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:44 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 1G" returned: 0 in 0.598s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:44 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 Aug 17 16:25:44 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:44 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:25:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Deleted volume successfully. Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-75dbddb7-456e-427e-9345-e3a9cf553b3c tempest-VolumesActionsTest-352994462 None] Lock "cinder-31e2111b-e6d4-4208-8092-6cc625eb00a4-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:44 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" returned: 0 in 0.432s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:44 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 is being set with open permissions: ugo+rw Aug 17 16:25:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:45 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 Aug 17 16:25:45 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:45 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:45 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info Aug 17 16:25:45 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:45 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info" returned: 0 in 0.377s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info is being set with open permissions: ugo+rw Aug 17 16:25:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:45 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info Aug 17 16:25:45 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7b18b55-6faf-4f98-b144-c807b47e7e65 req-5e7395e2-6bc0-4cd6-9d38-065f409d1d21 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:46 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.info" returned: 0 in 0.336s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.669s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7b18b55-6faf-4f98-b144-c807b47e7e65 req-5e7395e2-6bc0-4cd6-9d38-065f409d1d21 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.211s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7b18b55-6faf-4f98-b144-c807b47e7e65 req-5e7395e2-6bc0-4cd6-9d38-065f409d1d21 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1c42bbc6-2fbd-454f-a4d8-06ba4a94733a tempest-VolumesExtendTest-441234656 None] Create snapshot completed successfully Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a7b18b55-6faf-4f98-b144-c807b47e7e65 req-5e7395e2-6bc0-4cd6-9d38-065f409d1d21 tempest-AttachVolumeTestJSON-1096176667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-1c595023-4821-499a-a7ab-b701c4fd4cb3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78c9676d-7d92-4f7e-8c01-d77a05234bd7', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:25:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a7b18b55-6faf-4f98-b144-c807b47e7e65 req-5e7395e2-6bc0-4cd6-9d38-065f409d1d21 tempest-AttachVolumeTestJSON-1096176667 None] attachment_update completed successfully. Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:46 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:25:46 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d038af-50cc-4e30-bc92-92dc9be3a327]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:47 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:47 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:47 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.614s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:25:47 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.657s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 2G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 2G" returned: 0 in 0.209s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.964s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1997a1e5-2153-4b6e-acdc-3adbb31f4d49 tempest-VolumesExtendTest-441234656 None] Extend volume completed successfully. Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-quobyte-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Deleting offline snapshot 3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 of volume 6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] snapshot_file for this snap is: volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bea11f-49db-4d0b-b5ff-7ba1ec4c6b82]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:48 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 Aug 17 16:25:48 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:48 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" returned: 0 in 0.464s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dee602e-d456-4a5b-9505-d0f8b02fff29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6a87c-97e5-4d3f-aec0-c1011509ebd9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:49 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:49 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:49 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.608s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:49 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 Aug 17 16:25:49 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (026798a7-ec5c-476f-8d41-c38c50e63af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24564de4-4a9c-4af9-a0e5-0ed3c2f40d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24564de4-4a9c-4af9-a0e5-0ed3c2f40d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-289565221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ba7112-4200-4d36-b8a1-a11bd662d13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:50Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899da8e3-9769-44f6-a5d9-093902e8a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899da8e3-9769-44f6-a5d9-093902e8a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fd6c27-4336-45ef-b199-842b900ca2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fd6c27-4336-45ef-b199-842b900ca2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ba7112-4200-4d36-b8a1-a11bd662d13b', 'volume_name': 'volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51a6e0f-70ba-4df9-a628-169dc554d8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51a6e0f-70ba-4df9-a628-169dc554d8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dabce21-43d0-42fb-b4e2-03c24bb1a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Volume e5ba7112-4200-4d36-b8a1-a11bd662d13b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b', 'volume_size': 1} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-289565221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ba7112-4200-4d36-b8a1-a11bd662d13b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22275ae3071b433a829e56de0e628d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:50Z,use_quota=True,user_id='88bd06d5b76c4610945c9629d709864f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Creating volume e5ba7112-4200-4d36-b8a1-a11bd662d13b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:49 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:49 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b 1073741824 Aug 17 16:25:49 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:50 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" returned: 0 in 0.503s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:50 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751 Aug 17 16:25:50 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:50 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b 1073741824" returned: 0 in 0.533s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:50 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29.3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:50 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b Aug 17 16:25:50 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751" released by "_delete_snapshot" :: held 2.085s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" released by "delete_snapshot" :: held 2.128s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Created reservations ['6aba6489-4bcd-473b-a396-997a7fc8df02', '830a2969-66c1-49c7-9683-262e30d9b288', '669e7757-97a1-48e3-a700-fc5b64880a7c', 'b63e4a58-0cb8-4dc8-b59d-ae8e2dd51658'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:25:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Delete snapshot completed successfully. Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c779768-a398-452a-b975-3a806db7bd5e tempest-VolumesExtendTest-441234656 None] Lock "cinder-3fa4a8ba-e11b-4f5a-bbe3-f2da978d0751-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:50 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b" returned: 0 in 0.341s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dabce21-43d0-42fb-b4e2-03c24bb1a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc467c8-839f-44f4-bcdf-2d61fe704f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:50 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Volume volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b (e5ba7112-4200-4d36-b8a1-a11bd662d13b): created successfully Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc467c8-839f-44f4-bcdf-2d61fe704f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Flow 'volume_create_manager' (026798a7-ec5c-476f-8d41-c38c50e63af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f8aa2adc-6d19-4a39-abf3-2051f87636f1 tempest-AttachVolumeTestJSON-1096176667 None] Created volume successfully. Aug 17 16:25:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-6dee602e-d456-4a5b-9505-d0f8b02fff29-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "cinder-6dee602e-d456-4a5b-9505-d0f8b02fff29-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Acquiring lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:25:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" acquired by "delete_volume" :: waited 0.046s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04986f19-b2ff-4f06-9ea9-9fe2f3801d68]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (3d3e8bf8-e456-4a3f-99fe-cf978fa63449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:52 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:52 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d21fc1-4a27-41c5-be1f-67f57f30a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d21fc1-4a27-41c5-be1f-67f57f30a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-862831695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b56960-f93c-4ec5-a9ad-27efdd8a78bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:52Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a345e2a-1195-4f6f-bc85-f4a610c34e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a345e2a-1195-4f6f-bc85-f4a610c34e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c1634f-be21-4efb-beb2-8a3da73d50a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c1634f-be21-4efb-beb2-8a3da73d50a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b56960-f93c-4ec5-a9ad-27efdd8a78bc', 'volume_name': 'volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3017a5a-0d35-47b7-8d8b-b0f6f61fa66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3017a5a-0d35-47b7-8d8b-b0f6f61fa66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468d8809-ad63-477d-9490-f51a6414d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:52 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Volume 31b56960-f93c-4ec5-a9ad-27efdd8a78bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc', 'volume_size': 1} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-862831695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b56960-f93c-4ec5-a9ad-27efdd8a78bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:52Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Creating volume 31b56960-f93c-4ec5-a9ad-27efdd8a78bc {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:52 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:52 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc 1073741824 Aug 17 16:25:52 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:52 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.590s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:52 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29 Aug 17 16:25:52 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:53 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6dee602e-d456-4a5b-9505-d0f8b02fff29" returned: 0 in 0.425s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:53 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc 1073741824" returned: 0 in 0.794s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "cinder-quobyte-6dee602e-d456-4a5b-9505-d0f8b02fff29" released by "delete_volume" :: held 1.159s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef4c8f39-f798-4c4c-a4ae-9037c216615c req-c3abc278-f4e3-4d82-b475-a417543bd3ca tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:53 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc Aug 17 16:25:53 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Created reservations ['6a4bce53-62df-435c-b489-3f923d60c43a', 'f7f44d89-6541-4c53-9750-a23d682610c3', '1bc6ed19-72c6-4897-bf43-6bc28ed0aef2', 'c4571582-581a-44eb-90ad-095666308f91'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:53 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:25:53 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:53 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef4c8f39-f798-4c4c-a4ae-9037c216615c req-c3abc278-f4e3-4d82-b475-a417543bd3ca tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.394s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (468d8809-ad63-477d-9490-f51a6414d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b4ef7-a40b-4890-8cda-fe21a805c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef4c8f39-f798-4c4c-a4ae-9037c216615c req-c3abc278-f4e3-4d82-b475-a417543bd3ca tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:53 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Volume volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc (31b56960-f93c-4ec5-a9ad-27efdd8a78bc): created successfully Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6b4ef7-a40b-4890-8cda-fe21a805c194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (3d3e8bf8-e456-4a3f-99fe-cf978fa63449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e3b2f9c6-d572-490b-8c2f-e357b0803967 tempest-VolumesListAdminTestJSON-1256098997 None] Created volume successfully. Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-ef4c8f39-f798-4c4c-a4ae-9037c216615c req-c3abc278-f4e3-4d82-b475-a417543bd3ca tempest-AttachVolumeTestJSON-1096176667 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cff11fa1-2cfc-4a47-bf3a-453103e488c0', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:25:53 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:25:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Deleted volume successfully. Aug 17 16:25:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b52f9c2c-d6c4-4422-b32d-de2775186dd3 tempest-VolumesExtendTest-441234656 None] Lock "cinder-6dee602e-d456-4a5b-9505-d0f8b02fff29-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:25:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-ef4c8f39-f798-4c4c-a4ae-9037c216615c req-c3abc278-f4e3-4d82-b475-a417543bd3ca tempest-AttachVolumeTestJSON-1096176667 None] attachment_update completed successfully. Aug 17 16:25:54 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (dee0383c-d68c-4b41-93b9-1c08286836c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb074e24-f7d3-4cbc-9e9b-b2c3ebc6344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb074e24-f7d3-4cbc-9e9b-b2c3ebc6344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859303456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97c0bb1-01c6-4db0-804d-5f6fbea3f464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:55Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86482dd7-e50a-4e91-985d-e0fc9624c371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86482dd7-e50a-4e91-985d-e0fc9624c371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9da00ab-339f-4c7f-b0e2-31f39c44a38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9da00ab-339f-4c7f-b0e2-31f39c44a38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97c0bb1-01c6-4db0-804d-5f6fbea3f464', 'volume_name': 'volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1c1167-8108-4257-89f7-0c0061ccdcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c1c1167-8108-4257-89f7-0c0061ccdcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279f8009-a876-4d1a-be8d-2259d4fdeb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:55 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Volume e97c0bb1-01c6-4db0-804d-5f6fbea3f464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464', 'volume_size': 1} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-859303456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97c0bb1-01c6-4db0-804d-5f6fbea3f464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:55Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Creating volume e97c0bb1-01c6-4db0-804d-5f6fbea3f464 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:55 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:55 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 1073741824 Aug 17 16:25:55 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:55 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 1073741824" returned: 0 in 0.782s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:55 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 Aug 17 16:25:56 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:56 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279f8009-a876-4d1a-be8d-2259d4fdeb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed841c0f-1bc3-42b8-b955-9415ea438922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Volume volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 (e97c0bb1-01c6-4db0-804d-5f6fbea3f464): created successfully Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed841c0f-1bc3-42b8-b955-9415ea438922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (dee0383c-d68c-4b41-93b9-1c08286836c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-daae0d63-aa79-43fa-9ad0-1075e44a14fe tempest-VolumesListAdminTestJSON-1256098997 None] Created volume successfully. Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (409fd47f-3d95-47d5-b689-1c8c9645cf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b28fd2-3b42-4225-9c91-aab09f8c5bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b28fd2-3b42-4225-9c91-aab09f8c5bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208644029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07893a76-a686-4d6a-a1d4-1cca28237909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:56Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d49049-7e58-4f2d-82e7-01ef91a5daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d49049-7e58-4f2d-82e7-01ef91a5daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f218a2c-5bbf-4d13-bb50-15ae32ba1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f218a2c-5bbf-4d13-bb50-15ae32ba1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07893a76-a686-4d6a-a1d4-1cca28237909', 'volume_name': 'volume-07893a76-a686-4d6a-a1d4-1cca28237909', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc623c1-b7ec-4814-9439-696f001c7ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc623c1-b7ec-4814-9439-696f001c7ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766ff553-12f8-43a4-ac75-868054c8904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:56 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Volume 07893a76-a686-4d6a-a1d4-1cca28237909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07893a76-a686-4d6a-a1d4-1cca28237909', 'volume_size': 1} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-208644029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07893a76-a686-4d6a-a1d4-1cca28237909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:56Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Creating volume 07893a76-a686-4d6a-a1d4-1cca28237909 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:56 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:56 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 1073741824 Aug 17 16:25:56 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-0de89074-8155-487f-9f17-135e35106965 req-d5bbb349-4611-42d2-bf26-911131b57af0 tempest-AttachVolumeTestJSON-1096176667 None] Terminate volume connection completed successfully. Aug 17 16:25:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-0de89074-8155-487f-9f17-135e35106965 req-d5bbb349-4611-42d2-bf26-911131b57af0 tempest-AttachVolumeTestJSON-1096176667 None] Deleting attachment 78c9676d-7d92-4f7e-8c01-d77a05234bd7. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:25:57 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 1073741824" returned: 0 in 0.604s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:57 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 Aug 17 16:25:57 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:57 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909" returned: 0 in 0.419s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (766ff553-12f8-43a4-ac75-868054c8904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07893a76-a686-4d6a-a1d4-1cca28237909', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316e2386-a701-46f7-9d14-b5575b224f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Volume volume-07893a76-a686-4d6a-a1d4-1cca28237909 (07893a76-a686-4d6a-a1d4-1cca28237909): created successfully Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316e2386-a701-46f7-9d14-b5575b224f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (409fd47f-3d95-47d5-b689-1c8c9645cf3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-af4a60a5-071f-4449-b356-bc2072b81dd6 tempest-VolumesListTestJSON-1780198765 None] Created volume successfully. Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (0f3cc8c3-ac43-4186-856f-28c653099bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0fca64-e561-404f-a0d9-9854bff95821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0fca64-e561-404f-a0d9-9854bff95821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-197175824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb4a25d-fee4-42f6-9204-28061c3f793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:58Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac2bb20-01c6-4648-80d7-2f5b83fc3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac2bb20-01c6-4648-80d7-2f5b83fc3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c646197-ee3d-408f-975e-0b3f16052b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c646197-ee3d-408f-975e-0b3f16052b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb4a25d-fee4-42f6-9204-28061c3f793c', 'volume_name': 'volume-8bb4a25d-fee4-42f6-9204-28061c3f793c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe167bd-b98c-42c4-a446-39fab8b245a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe167bd-b98c-42c4-a446-39fab8b245a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e01cb-1237-4f15-bed7-ea1cdfdf494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:57 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Volume 8bb4a25d-fee4-42f6-9204-28061c3f793c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb4a25d-fee4-42f6-9204-28061c3f793c', 'volume_size': 1} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-197175824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb4a25d-fee4-42f6-9204-28061c3f793c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451ebba16185469dbefb993a32d86d76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:58Z,use_quota=True,user_id='69df62f7833645daaac71534ca4abf22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Creating volume 8bb4a25d-fee4-42f6-9204-28061c3f793c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:57 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:57 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c 1073741824 Aug 17 16:25:57 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-5d42fcdd-f9a1-4086-a1ef-1c305c7a2e8b req-a8a12a47-0490-4d1e-9fd7-71b1cd7ac8f6 tempest-AttachVolumeTestJSON-1096176667 None] Terminate volume connection completed successfully. Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-5d42fcdd-f9a1-4086-a1ef-1c305c7a2e8b req-a8a12a47-0490-4d1e-9fd7-71b1cd7ac8f6 tempest-AttachVolumeTestJSON-1096176667 None] Deleting attachment cff11fa1-2cfc-4a47-bf3a-453103e488c0. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:25:58 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c 1073741824" returned: 0 in 0.586s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:58 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c Aug 17 16:25:58 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:25:58 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e01cb-1237-4f15-bed7-ea1cdfdf494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb4a25d-fee4-42f6-9204-28061c3f793c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c45b6c-c49c-4154-9a44-28c1a45b5d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Volume volume-8bb4a25d-fee4-42f6-9204-28061c3f793c (8bb4a25d-fee4-42f6-9204-28061c3f793c): created successfully Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c45b6c-c49c-4154-9a44-28c1a45b5d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Flow 'volume_create_manager' (0f3cc8c3-ac43-4186-856f-28c653099bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:59 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-63160014-463c-4328-970b-603f6ddf990d tempest-VolumesListAdminTestJSON-1256098997 None] Created volume successfully. Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (44f4260e-4bf6-4863-a8b9-614e3e7d5d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44ce511-7159-4944-80ef-3d25a05f399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a44ce511-7159-4944-80ef-3d25a05f399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971749290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7d9961-7a38-4f76-9684-8b964c191bc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:59Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad9513-fc88-4602-980a-e66c06483293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cad9513-fc88-4602-980a-e66c06483293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6a47e6-b13c-4ba6-9a23-6e217c7c34cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6a47e6-b13c-4ba6-9a23-6e217c7c34cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7d9961-7a38-4f76-9684-8b964c191bc7', 'volume_name': 'volume-da7d9961-7a38-4f76-9684-8b964c191bc7', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7abcee-eb28-4dd4-9765-0ad80920a952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7abcee-eb28-4dd4-9765-0ad80920a952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b355329-9add-4784-8693-7257e7189476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:25:59 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Volume da7d9961-7a38-4f76-9684-8b964c191bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7d9961-7a38-4f76-9684-8b964c191bc7', 'volume_size': 1} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-971749290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7d9961-7a38-4f76-9684-8b964c191bc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:25:59Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Creating volume da7d9961-7a38-4f76-9684-8b964c191bc7 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:25:59 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:25:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:25:59 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 1073741824 Aug 17 16:25:59 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:00 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 1073741824" returned: 0 in 0.872s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:00 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 Aug 17 16:26:00 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:00 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b355329-9add-4784-8693-7257e7189476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7d9961-7a38-4f76-9684-8b964c191bc7', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a2e066-4e32-457b-92d2-79de1e2ff074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Volume volume-da7d9961-7a38-4f76-9684-8b964c191bc7 (da7d9961-7a38-4f76-9684-8b964c191bc7): created successfully Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a2e066-4e32-457b-92d2-79de1e2ff074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (44f4260e-4bf6-4863-a8b9-614e3e7d5d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:00 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3aad12b2-fa5b-4f58-9fc8-4b2bd382fc49 tempest-VolumesListTestJSON-1780198765 None] Created volume successfully. Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Flow 'volume_create_manager' (be71ad45-e70c-4753-baaf-5c09663c8e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b403124d-97a7-4965-8df4-c96b44759d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b403124d-97a7-4965-8df4-c96b44759d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be67e5-2be7-485c-82fb-51eca5d83a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d3d65cacd344dcbd7b8c38755e1f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:02Z,use_quota=True,user_id='6ef8224ce7464a9a8a0735c9dbf8c6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ffde77-70b7-496f-b161-3d894643ae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ffde77-70b7-496f-b161-3d894643ae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c44b1-0ae4-4c9d-8caf-b3208fd8c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c44b1-0ae4-4c9d-8caf-b3208fd8c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07be67e5-2be7-485c-82fb-51eca5d83a8e', 'volume_name': 'volume-07be67e5-2be7-485c-82fb-51eca5d83a8e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc2fc33-835f-424e-9211-c5c676b43134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc2fc33-835f-424e-9211-c5c676b43134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05664ee9-9922-4d5c-acd6-c0d34679fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:01 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Volume 07be67e5-2be7-485c-82fb-51eca5d83a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07be67e5-2be7-485c-82fb-51eca5d83a8e', 'volume_size': 1} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be67e5-2be7-485c-82fb-51eca5d83a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10d3d65cacd344dcbd7b8c38755e1f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:02Z,use_quota=True,user_id='6ef8224ce7464a9a8a0735c9dbf8c6ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Creating volume 07be67e5-2be7-485c-82fb-51eca5d83a8e {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:01 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:01 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e 1073741824 Aug 17 16:26:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:02 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e 1073741824" returned: 0 in 0.770s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (c724d62a-d8ee-423f-8b00-3d35cc952027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4d609-a9e3-496e-b004-2b20e910a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4d609-a9e3-496e-b004-2b20e910a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-109161258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae47637-096e-4806-90e4-138a54c8bc58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:02Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db1aa0c-5d79-4783-9f1e-fdabef2ee96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2db1aa0c-5d79-4783-9f1e-fdabef2ee96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b53ea4-1d52-49ee-a40a-32b718c9bcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b53ea4-1d52-49ee-a40a-32b718c9bcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae47637-096e-4806-90e4-138a54c8bc58', 'volume_name': 'volume-dae47637-096e-4806-90e4-138a54c8bc58', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc685be6-89cf-4a54-a246-41af6ba46d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc685be6-89cf-4a54-a246-41af6ba46d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f25256-ce9f-46b2-a958-1d33af73a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:02 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Volume dae47637-096e-4806-90e4-138a54c8bc58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae47637-096e-4806-90e4-138a54c8bc58', 'volume_size': 1} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:02 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e Aug 17 16:26:02 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:02 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-109161258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae47637-096e-4806-90e4-138a54c8bc58,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5e4d0af6442d18cdf3c83e23eede0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:02Z,use_quota=True,user_id='5bfc4bb7063a44c49f5094463d5403b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Creating volume dae47637-096e-4806-90e4-138a54c8bc58 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:03 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 1073741824 Aug 17 16:26:03 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05664ee9-9922-4d5c-acd6-c0d34679fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07be67e5-2be7-485c-82fb-51eca5d83a8e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aac553-1bc7-45b6-a19e-8e3d334204ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Flow 'volume_create_manager' (31e86b50-6939-4153-888f-b702b5bf2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37291524-9ec2-4bb3-9924-06f06d6540ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Volume volume-07be67e5-2be7-485c-82fb-51eca5d83a8e (07be67e5-2be7-485c-82fb-51eca5d83a8e): created successfully Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35aac553-1bc7-45b6-a19e-8e3d334204ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Flow 'volume_create_manager' (be71ad45-e70c-4753-baaf-5c09663c8e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37291524-9ec2-4bb3-9924-06f06d6540ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-135944698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1e4491-a034-4547-ac47-d7c861560a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2304aa176d4bb4aa9a2e2b838df549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:03Z,use_quota=True,user_id='9ac1d06352b64aad823ff88d1e6dd674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82842b8-1cbd-460e-9fc7-e4272a2742a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82842b8-1cbd-460e-9fc7-e4272a2742a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb6ce43-7436-41f0-8fb6-9d215e37693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb6ce43-7436-41f0-8fb6-9d215e37693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1e4491-a034-4547-ac47-d7c861560a55', 'volume_name': 'volume-2f1e4491-a034-4547-ac47-d7c861560a55', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84f4c29-19a2-4abb-b90b-9527ec9ef48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84f4c29-19a2-4abb-b90b-9527ec9ef48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b5313b-3f8e-4c8d-8ac6-c69d06ef347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Volume 2f1e4491-a034-4547-ac47-d7c861560a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1e4491-a034-4547-ac47-d7c861560a55', 'volume_size': 1} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f8a1084b-80e6-44ad-a153-0327f321907e tempest-VolumesListAdminTestJSON-428021061 None] Created volume successfully. Aug 17 16:26:03 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 1073741824" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:03 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 Aug 17 16:26:03 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:03 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58" returned: 0 in 0.276s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-135944698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1e4491-a034-4547-ac47-d7c861560a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2304aa176d4bb4aa9a2e2b838df549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:03Z,use_quota=True,user_id='9ac1d06352b64aad823ff88d1e6dd674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Creating volume 2f1e4491-a034-4547-ac47-d7c861560a55 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f25256-ce9f-46b2-a958-1d33af73a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae47637-096e-4806-90e4-138a54c8bc58', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564df878-047b-4224-abe5-049328cbff68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:03 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 1073741824 Aug 17 16:26:03 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Acquiring lock "cinder-07be67e5-2be7-485c-82fb-51eca5d83a8e-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Volume volume-dae47637-096e-4806-90e4-138a54c8bc58 (dae47637-096e-4806-90e4-138a54c8bc58): created successfully Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564df878-047b-4224-abe5-049328cbff68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Flow 'volume_create_manager' (c724d62a-d8ee-423f-8b00-3d35cc952027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "cinder-07be67e5-2be7-485c-82fb-51eca5d83a8e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-38b7587f-ec33-4127-8807-4c1c01b1fc5f tempest-VolumesListTestJSON-1780198765 None] Created volume successfully. Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Acquiring lock "cinder-quobyte-07be67e5-2be7-485c-82fb-51eca5d83a8e" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "cinder-quobyte-07be67e5-2be7-485c-82fb-51eca5d83a8e" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885a153-face-4131-80f4-58da2d7993a6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-8bb4a25d-fee4-42f6-9204-28061c3f793c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-8bb4a25d-fee4-42f6-9204-28061c3f793c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:04 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e Aug 17 16:26:04 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-quobyte-8bb4a25d-fee4-42f6-9204-28061c3f793c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-8bb4a25d-fee4-42f6-9204-28061c3f793c" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0dcea-6d7e-4288-95b0-c22d0d18e9eb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:04 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c Aug 17 16:26:04 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:04 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 1073741824" returned: 0 in 0.820s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:04 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e" returned: 0 in 0.611s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:04 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e Aug 17 16:26:04 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:04 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 Aug 17 16:26:04 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:05 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c" returned: 0 in 0.690s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:05 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c Aug 17 16:26:05 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:05 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:05 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07be67e5-2be7-485c-82fb-51eca5d83a8e" returned: 0 in 0.529s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55" returned: 0 in 0.474s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "cinder-quobyte-07be67e5-2be7-485c-82fb-51eca5d83a8e" released by "delete_volume" :: held 1.246s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b5313b-3f8e-4c8d-8ac6-c69d06ef347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1e4491-a034-4547-ac47-d7c861560a55', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b31782-974c-48f8-ab29-676413e692bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:05 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Volume volume-2f1e4491-a034-4547-ac47-d7c861560a55 (2f1e4491-a034-4547-ac47-d7c861560a55): created successfully Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b31782-974c-48f8-ab29-676413e692bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Flow 'volume_create_manager' (31e86b50-6939-4153-888f-b702b5bf2039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-e5ba7112-4200-4d36-b8a1-a11bd662d13b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5eb67de3-1f34-4e96-a775-3fa4e9d7f65b tempest-VolumesNegativeTest-729466019 None] Created volume successfully. Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-e5ba7112-4200-4d36-b8a1-a11bd662d13b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Created reservations ['6df03c80-ec4b-4f9e-b690-e2c6106b2db9', '573b33d4-8bf9-4af0-a1ff-eda625673e97', 'ef6974f6-74d0-4c7c-8988-753d83c6b66e', '23e2d180-f963-4625-8fc9-321d03caeb04'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-quobyte-e5ba7112-4200-4d36-b8a1-a11bd662d13b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:05 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8bb4a25d-fee4-42f6-9204-28061c3f793c" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-8bb4a25d-fee4-42f6-9204-28061c3f793c" released by "delete_volume" :: held 1.182s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-e5ba7112-4200-4d36-b8a1-a11bd662d13b" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c9d39b-7f4b-4a3c-a655-28efa8515797]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Created reservations ['e5ed6b35-f398-4837-8986-01c90219284d', 'd9acbae4-c9fb-4ff1-809e-5d85befac3a1', '8a523226-5b41-4816-b22a-9e4f83c42d7d', 'f438feed-1118-499a-a188-8489c7d4e37c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:05 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:05 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:05 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b Aug 17 16:26:05 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:05 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:05 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:06 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.374s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Deleted volume successfully. Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9c618af2-fa12-44bb-80f1-11a74a069dda tempest-VolumesListAdminTestJSON-428021061 None] Lock "cinder-07be67e5-2be7-485c-82fb-51eca5d83a8e-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:06 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b" returned: 0 in 0.496s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:06 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b Aug 17 16:26:06 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:06 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Deleted volume successfully. Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9093107a-d6a4-447e-8415-c93e8e2c5dd5 tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-8bb4a25d-fee4-42f6-9204-28061c3f793c-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:06 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e5ba7112-4200-4d36-b8a1-a11bd662d13b" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-e5ba7112-4200-4d36-b8a1-a11bd662d13b" released by "delete_volume" :: held 0.873s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Created reservations ['cad99bf9-72d3-4f6a-8935-a11b2355fa32', 'a369712b-a812-4020-8831-c8517f0522ec', 'f7a4ed4f-fa37-4384-b9ea-53fe26fff703', '3fb2dbba-b100-48ce-8780-0dce2725275a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:06 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:06 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-e97c0bb1-01c6-4db0-804d-5f6fbea3f464-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-e97c0bb1-01c6-4db0-804d-5f6fbea3f464-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-quobyte-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f464b134-738d-4ba7-be58-61361a0f8db7]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:06 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.343s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Deleted volume successfully. Aug 17 16:26:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bdfebfef-4d9f-4eb4-98ef-8a2dd164afe4 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-e5ba7112-4200-4d36-b8a1-a11bd662d13b-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:07 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 Aug 17 16:26:07 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:07 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" returned: 0 in 0.482s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:07 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464 Aug 17 16:26:07 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:07 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" returned: 0 in 0.304s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-1c595023-4821-499a-a7ab-b701c4fd4cb3-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-dae47637-096e-4806-90e4-138a54c8bc58-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-e97c0bb1-01c6-4db0-804d-5f6fbea3f464" released by "delete_volume" :: held 0.878s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-dae47637-096e-4806-90e4-138a54c8bc58-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-1c595023-4821-499a-a7ab-b701c4fd4cb3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-quobyte-dae47637-096e-4806-90e4-138a54c8bc58" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-quobyte-1c595023-4821-499a-a7ab-b701c4fd4cb3" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-dae47637-096e-4806-90e4-138a54c8bc58" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-1c595023-4821-499a-a7ab-b701c4fd4cb3" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Created reservations ['1842d7fa-f742-4c25-9f39-8c7c87392c0d', '9d1cc4df-62a1-4e7a-a0bb-73ab4931daa8', '82993ac8-e86a-45c9-b269-70c17c4858fb', '5b2b849b-a73c-46d6-a09a-46138cd18476'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d309e84-8e1c-4e7e-a022-9f0cf810761c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc158732-971c-4252-a79a-e3dcb5ed322a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:08 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 Aug 17 16:26:08 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:08 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:08 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:08 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 Aug 17 16:26:08 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:08 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58" returned: 0 in 0.609s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:08 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.434s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:08 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58 Aug 17 16:26:08 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Deleted volume successfully. Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-31b56960-f93c-4ec5-a9ad-27efdd8a78bc-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ebe3f415-0452-44c5-967d-7ca56b48e12b tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-e97c0bb1-01c6-4db0-804d-5f6fbea3f464-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-31b56960-f93c-4ec5-a9ad-27efdd8a78bc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:08 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3" returned: 0 in 0.777s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "cinder-quobyte-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:08 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3 Aug 17 16:26:08 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a8c2e-94e5-4f05-af51-aaa3d8e8f0ca]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:08 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dae47637-096e-4806-90e4-138a54c8bc58" returned: 0 in 0.386s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-dae47637-096e-4806-90e4-138a54c8bc58" released by "delete_volume" :: held 1.068s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Created reservations ['5d616bdb-5d63-4e96-8f43-b930178529c3', 'b07ef533-dc8d-49fc-b697-bf8e374354ce', 'a64d97df-0a33-46c9-b355-8c16fed19cc8', 'd75961ca-eefd-4865-8240-c48b406b033f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:09 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc Aug 17 16:26:09 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:09 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c595023-4821-499a-a7ab-b701c4fd4cb3" returned: 0 in 0.407s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-1c595023-4821-499a-a7ab-b701c4fd4cb3" released by "delete_volume" :: held 1.284s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:09 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:09 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Created reservations ['3cecf6a3-adce-4a3a-a917-b031403831c9', '7598e1ff-e0f2-42d3-a10a-7af32176cab6', 'e74943d1-7562-4a68-ac29-306dd6adfab0', '37064679-c0ef-4254-9f65-5d9351b2a0f4'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:09 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" returned: 0 in 0.638s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:09 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc Aug 17 16:26:09 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:09 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:09 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:09 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.402s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Deleted volume successfully. Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d6a91f44-c912-429b-948e-2f315dcd0b70 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-dae47637-096e-4806-90e4-138a54c8bc58-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:09 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.420s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Deleted volume successfully. Aug 17 16:26:09 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-quobyte-31b56960-f93c-4ec5-a9ad-27efdd8a78bc" released by "delete_volume" :: held 1.200s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9dc379dc-284f-4f77-9445-e1e68e6381a0 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-1c595023-4821-499a-a7ab-b701c4fd4cb3-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Created reservations ['c5c8a049-4b7f-4e97-8fcf-1e6572576d6f', 'eeca4934-eeac-4527-9961-e0350fbdd40b', 'aa2284ce-7df5-49e8-a391-871e443a9e2a', '75fc3939-cd21-469f-98bc-71c4439ab993'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-da7d9961-7a38-4f76-9684-8b964c191bc7-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-c5a436cd-0dda-4a2a-9407-77b481017b18-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:10 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:10 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-da7d9961-7a38-4f76-9684-8b964c191bc7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-c5a436cd-0dda-4a2a-9407-77b481017b18-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "cinder-quobyte-c5a436cd-0dda-4a2a-9407-77b481017b18" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-quobyte-da7d9961-7a38-4f76-9684-8b964c191bc7" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-c5a436cd-0dda-4a2a-9407-77b481017b18" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-da7d9961-7a38-4f76-9684-8b964c191bc7" acquired by "delete_volume" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b498e-a47d-43c7-b041-557f2f2362ac]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed1522c-b5c0-4795-9043-fe4b9a30e83e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:10 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Deleted volume successfully. Aug 17 16:26:10 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 Aug 17 16:26:10 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:10 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 Aug 17 16:26:10 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-eaa60508-af67-42c3-aa78-c7e26e13ea5e tempest-VolumesListAdminTestJSON-1256098997 None] Lock "cinder-31b56960-f93c-4ec5-a9ad-27efdd8a78bc-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:11 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:11 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7" returned: 0 in 0.600s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18" returned: 0 in 0.643s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:11 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7 Aug 17 16:26:11 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:11 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18 Aug 17 16:26:11 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:11 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c5a436cd-0dda-4a2a-9407-77b481017b18" returned: 0 in 0.373s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-quobyte-c5a436cd-0dda-4a2a-9407-77b481017b18" released by "delete_volume" :: held 1.103s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:11 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-da7d9961-7a38-4f76-9684-8b964c191bc7" returned: 0 in 0.510s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-da7d9961-7a38-4f76-9684-8b964c191bc7" released by "delete_volume" :: held 1.174s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Created reservations ['a16e4f50-f905-4a05-98a7-9d1d07f452e0', '47d8eee6-b5ef-4361-8164-4ee357809e17', '104102ce-41c2-40d9-bbae-54007ccda196', '911006f4-870c-455c-b60a-d389001d98b6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Created reservations ['3a9bd893-d2c0-43c5-ae82-02b450cd93ca', '8ac689ff-3c25-45ef-a628-0dc41e1e1e87', 'f27d183e-c1dd-4db6-936f-c3cd5131d4cf', '73d9dbd9-f373-40a8-839b-15e8fa23b671'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:12 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:12 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:12 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:12 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:12 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:12 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Deleted volume successfully. Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8143954a-06c3-4274-abc9-2b6636f287f6 tempest-AttachVolumeTestJSON-1096176667 None] Lock "cinder-c5a436cd-0dda-4a2a-9407-77b481017b18-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:12 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.425s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:12 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Deleted volume successfully. Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3a57b3df-92b5-487f-a61a-e74ea9c421fc tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-da7d9961-7a38-4f76-9684-8b964c191bc7-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-07893a76-a686-4d6a-a1d4-1cca28237909-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-07893a76-a686-4d6a-a1d4-1cca28237909-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "cinder-quobyte-07893a76-a686-4d6a-a1d4-1cca28237909" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-07893a76-a686-4d6a-a1d4-1cca28237909" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[47296f54-49b0-4a1f-975b-edea50a31265]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:13 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 Aug 17 16:26:13 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:13 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909" returned: 0 in 0.546s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:13 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909 Aug 17 16:26:13 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:13 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-07893a76-a686-4d6a-a1d4-1cca28237909" returned: 0 in 0.391s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-quobyte-07893a76-a686-4d6a-a1d4-1cca28237909" released by "delete_volume" :: held 1.009s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Created reservations ['83090474-983b-4c71-a0d0-163f563e9e2b', 'db83e1a3-ba8d-45b1-bc05-6e93d909cb56', '98350163-f0c9-42c6-b0a9-1633774d4899', '2b195b09-4191-406a-afef-7853f7e08499'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:14 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:14 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:14 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Deleted volume successfully. Aug 17 16:26:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5d469277-5d35-41de-abd1-b643021dc8c5 tempest-VolumesListTestJSON-1780198765 None] Lock "cinder-07893a76-a686-4d6a-a1d4-1cca28237909-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:24 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=122,cinder:UPDATE=176,cinder:INSERT=37,cinder:DELETE=12 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:26:24 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=123,cinder:UPDATE=151,cinder:INSERT=36,cinder:DELETE=15 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Flow 'volume_create_manager' (b1792025-2931-467b-adb2-9f21f41d98a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2b014c-cca4-4550-bd80-30dd1d44d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2b014c-cca4-4550-bd80-30dd1d44d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-633500652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52564ef0-ccad-4478-9115-97038075e0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9474c8f83bc14118b7bd166208f1758e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:25Z,use_quota=True,user_id='91285462d1ef47e399ec191bb18fd18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cee43c-f5d5-49d8-a45a-228667d38eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cee43c-f5d5-49d8-a45a-228667d38eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f91e84-208c-4746-ac20-ac9d29b9ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f91e84-208c-4746-ac20-ac9d29b9ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52564ef0-ccad-4478-9115-97038075e0fe', 'volume_name': 'volume-52564ef0-ccad-4478-9115-97038075e0fe', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8403e5-0523-4ac0-ba44-badeed1eed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c8403e5-0523-4ac0-ba44-badeed1eed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10d4dc3-612c-4704-8cc1-d9a66f24f6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Volume 52564ef0-ccad-4478-9115-97038075e0fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52564ef0-ccad-4478-9115-97038075e0fe', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 16:26:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Trying to clone 52564ef0-ccad-4478-9115-97038075e0fe from image 9d40602e-5637-4537-aeab-5c295ac7c705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:26:26 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Image download 20.69 MB at 20.69 MB/s Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[241764e7-af05-42b2-bd1e-3119a37a891d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:26 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD Aug 17 16:26:26 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:26 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 is fetched for user 91285462d1ef47e399ec191bb18fd18c. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c05c61-d1e4-4d5a-a599-ab7607d89e17]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:27 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD Aug 17 16:26:27 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:27 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-633500652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52564ef0-ccad-4478-9115-97038075e0fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9474c8f83bc14118b7bd166208f1758e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:25Z,use_quota=True,user_id='91285462d1ef47e399ec191bb18fd18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Creating volume 52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:27 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1073741824 Aug 17 16:26:27 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:28 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1073741824" returned: 0 in 0.731s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:28 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe Aug 17 16:26:28 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:28 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe" returned: 0 in 0.402s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Attempting download of 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume 52564ef0-ccad-4478-9115-97038075e0fe. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[795fa680-47d4-47b1-b6e7-9cd570fcd97c]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:28 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4 Aug 17 16:26:28 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:29 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4" returned: 0 in 0.565s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:29 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4 Aug 17 16:26:29 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:29 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4" returned: 1 in 0.543s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_fsndvky4' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[77266ee9-c143-4eed-b6e5-95e39bb2bc60]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:30 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD Aug 17 16:26:30 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:30 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD" returned: 0 in 0.547s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:30 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] 9d40602e-5637-4537-aeab-5c295ac7c705 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:26:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:30 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe Aug 17 16:26:30 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:33 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe" returned: 0 in 3.013s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:33 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_vx3rjch1devstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:26:33 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Converted 112.00 MB image at 37.15 MB/s Aug 17 16:26:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:33 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1G Aug 17 16:26:33 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:34 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe 1G" returned: 0 in 0.607s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Downloaded image 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume 52564ef0-ccad-4478-9115-97038075e0fe successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 for user 91285462d1ef47e399ec191bb18fd18c is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Marking volume 52564ef0-ccad-4478-9115-97038075e0fe as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Copying metadata from image 9d40602e-5637-4537-aeab-5c295ac7c705 to 52564ef0-ccad-4478-9115-97038075e0fe. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Creating volume glance metadata for volume 52564ef0-ccad-4478-9115-97038075e0fe backed by image 9d40602e-5637-4537-aeab-5c295ac7c705 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10d4dc3-612c-4704-8cc1-d9a66f24f6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52564ef0-ccad-4478-9115-97038075e0fe', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f1f01-3aa9-4342-ba98-7d38693f4ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Volume volume-52564ef0-ccad-4478-9115-97038075e0fe (52564ef0-ccad-4478-9115-97038075e0fe): created successfully Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f91f1f01-3aa9-4342-ba98-7d38693f4ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Flow 'volume_create_manager' (b1792025-2931-467b-adb2-9f21f41d98a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-332e655e-3f05-4510-954d-156a841a5f77 tempest-VolumesImageMetadata-359288465 None] Created volume successfully. Aug 17 16:26:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2a36ef70-813c-44d6-ae70-1a3b2a4e2939 tempest-GroupSnapshotsV319Test-2074726126 None] Group tempest-GroupSnapshotsV319Test-Group-2133958046: creating Aug 17 16:26:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2a36ef70-813c-44d6-ae70-1a3b2a4e2939 tempest-GroupSnapshotsV319Test-2074726126 None] Group tempest-GroupSnapshotsV319Test-Group-2133958046: created successfully Aug 17 16:26:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2a36ef70-813c-44d6-ae70-1a3b2a4e2939 tempest-GroupSnapshotsV319Test-2074726126 None] Create group completed successfully. Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Acquiring lock "cinder-52564ef0-ccad-4478-9115-97038075e0fe-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "cinder-52564ef0-ccad-4478-9115-97038075e0fe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Acquiring lock "cinder-quobyte-52564ef0-ccad-4478-9115-97038075e0fe" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "cinder-quobyte-52564ef0-ccad-4478-9115-97038075e0fe" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff18760-1688-4756-9b68-b63fc0d9dcef]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:35 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe Aug 17 16:26:35 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:36 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe" returned: 0 in 0.474s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Acquiring lock "cinder-2f1e4491-a034-4547-ac47-d7c861560a55-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:36 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe Aug 17 16:26:36 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "cinder-2f1e4491-a034-4547-ac47-d7c861560a55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Acquiring lock "cinder-quobyte-2f1e4491-a034-4547-ac47-d7c861560a55" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "cinder-quobyte-2f1e4491-a034-4547-ac47-d7c861560a55" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3802f16-2d00-4945-920a-41890d5cb0d3]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:36 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 Aug 17 16:26:36 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:36 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-52564ef0-ccad-4478-9115-97038075e0fe" returned: 0 in 0.622s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "cinder-quobyte-52564ef0-ccad-4478-9115-97038075e0fe" released by "delete_volume" :: held 1.161s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:36 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Created reservations ['ac02585b-7a37-4836-a49e-9eb9fcc291c0', '2294a386-44e1-42f8-bf7d-d88683cc0c05', '193c61bf-d35a-49df-9931-bdac71402a6f', '3f72c6cf-18e5-403c-b6a3-7073391bc532'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:37 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55" returned: 0 in 0.743s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:37 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:37 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:37 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55 Aug 17 16:26:37 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:37 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Flow 'volume_create_manager' (a969273a-ec07-4808-b80d-ce2bcfa66854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2786aade-6563-4e12-8889-ddacb86de40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2f1e4491-a034-4547-ac47-d7c861560a55" returned: 0 in 0.401s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:37 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2786aade-6563-4e12-8889-ddacb86de40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468064193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=456b2f8d-37e1-4153-a860-d2380ee0da63,host='devstack@QuobyteHD#QuobyteHD',id=841ad84c-3353-4713-9ef0-2c61c17c530a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca57db14f594c6db84c68fb12dcae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:37Z,use_quota=True,user_id='2f399f1079eb41b39f0c58a88c08e0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79bd94af-15a7-4c84-86ce-fe4aa97a135d),volume_type_id=79bd94af-15a7-4c84-86ce-fe4aa97a135d)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d02bfbe-09db-4844-a032-4d08d5b5a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d02bfbe-09db-4844-a032-4d08d5b5a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdec6f50-4b88-4a59-bd2f-ba768b913593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdec6f50-4b88-4a59-bd2f-ba768b913593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '841ad84c-3353-4713-9ef0-2c61c17c530a', 'volume_name': 'volume-841ad84c-3353-4713-9ef0-2c61c17c530a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cf2e52-cd30-4dde-9aac-f9184873a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cf2e52-cd30-4dde-9aac-f9184873a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad8b12-6cd1-40c4-ada5-01ce65fb00e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Volume 841ad84c-3353-4713-9ef0-2c61c17c530a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-841ad84c-3353-4713-9ef0-2c61c17c530a', 'volume_size': 1} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=456b2f8d-37e1-4153-a860-d2380ee0da63,created_at=2026-08-17T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468064193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=456b2f8d-37e1-4153-a860-d2380ee0da63,host='devstack@QuobyteHD#QuobyteHD',id=841ad84c-3353-4713-9ef0-2c61c17c530a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ca57db14f594c6db84c68fb12dcae4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:37Z,use_quota=True,user_id='2f399f1079eb41b39f0c58a88c08e0ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79bd94af-15a7-4c84-86ce-fe4aa97a135d),volume_type_id=79bd94af-15a7-4c84-86ce-fe4aa97a135d)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Creating volume 841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:37 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.563s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "cinder-quobyte-2f1e4491-a034-4547-ac47-d7c861560a55" released by "delete_volume" :: held 1.325s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:37 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a 1073741824 Aug 17 16:26:37 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Deleted volume successfully. Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faceb870-a5a9-428b-aa6d-cfd2d58477d4 tempest-VolumesImageMetadata-359288465 None] Lock "cinder-52564ef0-ccad-4478-9115-97038075e0fe-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Created reservations ['6d798e21-3636-4239-8384-53886d825590', 'c36e0484-6dbc-4a35-ac9c-10a0b49e3b1d', '568e9864-deed-40ce-92b0-099ae4415de9', '0a1de2f2-674b-4558-ae1e-5f789e0940cb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:37 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:37 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:38 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.356s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Deleted volume successfully. Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e9367f25-dc10-4ae9-982f-11ac48b7486e tempest-VolumesNegativeTest-729466019 None] Lock "cinder-2f1e4491-a034-4547-ac47-d7c861560a55-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:38 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a 1073741824" returned: 0 in 0.629s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:38 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a Aug 17 16:26:38 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (4d66cec2-6040-49e0-9f65-cf190248afa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c213c3-7cfd-40da-9498-32cc333c2f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c213c3-7cfd-40da-9498-32cc333c2f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66997187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a72bbd2-4204-47c8-a6b9-67ec38ed08d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:38Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32006342-cac0-4f9d-a149-e4a518e9b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32006342-cac0-4f9d-a149-e4a518e9b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1451cdd-7a69-49f2-b9bb-98baf5da949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1451cdd-7a69-49f2-b9bb-98baf5da949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a72bbd2-4204-47c8-a6b9-67ec38ed08d3', 'volume_name': 'volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f90056-9792-4618-854c-9f51a7e8559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30f90056-9792-4618-854c-9f51a7e8559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee89cd9-4801-4386-aa64-66b4d2dbd469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Volume 6a72bbd2-4204-47c8-a6b9-67ec38ed08d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3', 'volume_size': 1} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:38 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a" returned: 0 in 0.356s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-66997187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a72bbd2-4204-47c8-a6b9-67ec38ed08d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:38Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Creating volume 6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:38 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:38 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 1073741824 Aug 17 16:26:38 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ad8b12-6cd1-40c4-ada5-01ce65fb00e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-841ad84c-3353-4713-9ef0-2c61c17c530a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1b20b6-9b39-41ab-83c9-3a7e8f912b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Volume volume-841ad84c-3353-4713-9ef0-2c61c17c530a (841ad84c-3353-4713-9ef0-2c61c17c530a): created successfully Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c1b20b6-9b39-41ab-83c9-3a7e8f912b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Flow 'volume_create_manager' (a969273a-ec07-4808-b80d-ce2bcfa66854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b4c15535-03c4-44bf-943e-cf604be4d8f9 tempest-GroupSnapshotsV319Test-2074726126 None] Created volume successfully. Aug 17 16:26:39 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 1073741824" returned: 0 in 0.668s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:39 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 Aug 17 16:26:39 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:39 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee89cd9-4801-4386-aa64-66b4d2dbd469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db12748-87b0-48a8-882f-d20998241ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Volume volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 (6a72bbd2-4204-47c8-a6b9-67ec38ed08d3): created successfully Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db12748-87b0-48a8-882f-d20998241ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (4d66cec2-6040-49e0-9f65-cf190248afa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-974a6596-e36f-4df4-afb2-38e6a08e3586 tempest-VolumesSnapshotTestJSON-855968631 None] Created volume successfully. Aug 17 16:26:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] GroupSnapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: creating. Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Group snapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: creating. {{(pid=94468) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Creating offline snapshot 810561f7-9f7d-4db2-9055-688b42d917d8 of volume 841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[898abb6b-0739-48ec-9740-ed4eecf50cb2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:40 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a Aug 17 16:26:40 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:40 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a" returned: 0 in 0.519s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:41 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 1G Aug 17 16:26:41 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:41 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 1G" returned: 0 in 0.555s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841ad84c-3353-4713-9ef0-2c61c17c530a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:41 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841ad84c-3353-4713-9ef0-2c61c17c530a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 Aug 17 16:26:41 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:41 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-841ad84c-3353-4713-9ef0-2c61c17c530a -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8" returned: 0 in 0.380s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:41 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:26:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:41 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 Aug 17 16:26:41 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:42 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:42 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info Aug 17 16:26:42 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:42 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:42 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 17 16:26:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:42 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info Aug 17 16:26:42 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:42 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.info" returned: 0 in 0.388s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.991s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Creating offline snapshot b7d7547d-9b84-46cb-90e3-0fa04d071072 of volume 6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc72792-ace6-4142-8c99-f8195689e10e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-98912c89-c21f-4fe4-a9b4-d16902a87fb3 tempest-GroupSnapshotsV319Test-2074726126 None] group_snapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: created successfully Aug 17 16:26:43 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 Aug 17 16:26:43 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:43 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" returned: 0 in 0.521s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:43 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 1G Aug 17 16:26:43 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Flow 'volume_create_manager' (21180e04-9e74-4ea3-81cc-d86832abfa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9bcf60-9557-4ae5-93f9-af774fd587cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff9bcf60-9557-4ae5-93f9-af774fd587cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-149335599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec427260-68b8-4351-87fb-8dff122c5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c03b5400ac4d09a748f5dbddfb9b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:44Z,use_quota=True,user_id='c49ff4dd4d964a5496d9040a7aed3500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86037fe0-814d-4640-a5d0-a09071635ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86037fe0-814d-4640-a5d0-a09071635ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6881a5-301c-41ae-9769-f678a8fa133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6881a5-301c-41ae-9769-f678a8fa133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec427260-68b8-4351-87fb-8dff122c5070', 'volume_name': 'volume-ec427260-68b8-4351-87fb-8dff122c5070', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e5e02a-4fd1-4f1f-85bc-7fe87a810907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e5e02a-4fd1-4f1f-85bc-7fe87a810907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae0161-3119-47cb-92f4-29bec2e2e76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:44 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Volume ec427260-68b8-4351-87fb-8dff122c5070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec427260-68b8-4351-87fb-8dff122c5070', 'volume_size': 1} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] group_snapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: deleting Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] group_snapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: deleting {{(pid=94468) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 17 16:26:44 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 1G" returned: 0 in 0.642s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:44 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 Aug 17 16:26:44 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "cinder-quobyte-810561f7-9f7d-4db2-9055-688b42d917d8" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-810561f7-9f7d-4db2-9055-688b42d917d8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Deleting offline snapshot 810561f7-9f7d-4db2-9055-688b42d917d8 of volume 841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] snapshot_file for this snap is: volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c31e7d7-eb4a-4f10-bf75-2ec1eaaea773]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:44 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 Aug 17 16:26:44 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:44 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072" returned: 0 in 0.393s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:44 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 is being set with open permissions: ugo+rw Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:44 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 Aug 17 16:26:44 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:44 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8" returned: 0 in 0.492s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-841ad84c-3353-4713-9ef0-2c61c17c530a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a19c8b-f5f7-4688-b1e4-73f52a24f6d4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:44 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:45 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info Aug 17 16:26:45 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:45 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a Aug 17 16:26:45 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:45 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info" returned: 0 in 0.347s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info is being set with open permissions: ugo+rw Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:45 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:45 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info Aug 17 16:26:45 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:45 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 Aug 17 16:26:45 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:45 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.info" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.624s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-149335599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec427260-68b8-4351-87fb-8dff122c5070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c03b5400ac4d09a748f5dbddfb9b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:44Z,use_quota=True,user_id='c49ff4dd4d964a5496d9040a7aed3500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Creating volume ec427260-68b8-4351-87fb-8dff122c5070 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:45 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:45 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 1073741824 Aug 17 16:26:45 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d0fc972c-8f06-4755-8d66-0ec2739da96c tempest-VolumesSnapshotTestJSON-855968631 None] Create snapshot completed successfully Aug 17 16:26:45 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8" returned: 0 in 0.470s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:45 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8 Aug 17 16:26:45 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:46 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a.810561f7-9f7d-4db2-9055-688b42d917d8" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-810561f7-9f7d-4db2-9055-688b42d917d8" released by "_delete_snapshot" :: held 1.893s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" released by "delete_snapshot" :: held 1.928s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:46 devstack cinder-volume[94468]: WARNING cinder.quota [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1356061665 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1356061665, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:26:46 devstack cinder-volume[94468]: WARNING cinder.quota [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1356061665 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1356061665, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:26:46 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] Created reservations ['4e446126-bf16-4765-8726-2c048bafec89', '3050bf33-e17a-4f5c-9da8-a1df8b4818c2', 'c41b9435-7d75-4bd0-9a9a-9d4e3fe4128a', '93612c8e-111f-4a14-9301-015d85e7f23c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 1073741824" returned: 0 in 0.719s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-b7d7547d-9b84-46cb-90e3-0fa04d071072-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-b7d7547d-9b84-46cb-90e3-0fa04d071072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:46 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 Aug 17 16:26:46 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-08757ac4-a52b-4260-b81c-659e2a7e54f5 tempest-GroupSnapshotsV319Test-2074726126 None] group_snapshot c48e11dc-5da5-4793-a2ca-973758f0e46f: deleted successfully Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-b7d7547d-9b84-46cb-90e3-0fa04d071072" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-b7d7547d-9b84-46cb-90e3-0fa04d071072" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Deleting offline snapshot b7d7547d-9b84-46cb-90e3-0fa04d071072 of volume 6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] snapshot_file for this snap is: volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[23be980a-5001-4766-8825-87919bcebcae]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:46 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:46 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:46 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:46 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 Aug 17 16:26:46 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae0161-3119-47cb-92f4-29bec2e2e76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec427260-68b8-4351-87fb-8dff122c5070', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660f8403-2b92-4fa9-bbb1-0da47c2808e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:46 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Volume volume-ec427260-68b8-4351-87fb-8dff122c5070 (ec427260-68b8-4351-87fb-8dff122c5070): created successfully Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (660f8403-2b92-4fa9-bbb1-0da47c2808e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Flow 'volume_create_manager' (21180e04-9e74-4ea3-81cc-d86832abfa74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-21595236-e9e3-4790-8ea4-105ff2847357 tempest-VolumesTransfersV357Test-1368511607 None] Created volume successfully. Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:47 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.494s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1198c3f-3915-4c86-b1aa-ab37cd4098b1]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:47 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a Aug 17 16:26:47 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:47 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072" returned: 0 in 0.752s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4127ecb-0d37-43ac-aadb-94a07cba3e88]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:47 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 Aug 17 16:26:47 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:47 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a" returned: 0 in 0.675s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:47 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a Aug 17 16:26:48 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:48 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" returned: 0 in 0.859s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:48 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-841ad84c-3353-4713-9ef0-2c61c17c530a" returned: 0 in 0.537s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:48 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 Aug 17 16:26:48 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "cinder-quobyte-841ad84c-3353-4713-9ef0-2c61c17c530a" released by "delete_volume" :: held 1.354s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1f44245b-c295-42f3-97ab-3b5ee5caf980 tempest-VolumesTransfersV357Test-1923786563 None] Transfer volume completed successfully. Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Created reservations ['a22e670d-be5b-4414-9ae3-cf116c66a359'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:48 devstack cinder-volume[94468]: WARNING cinder.quota [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1356061665 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1356061665, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Created reservations ['ba3d59eb-0307-401a-b855-9b2373e8a933', 'aef3e5b7-7854-4d53-a007-ac40a1726848', 'fd0259b0-3c47-43ca-b25a-9efdd18311b6', '976ae4a4-ebd8-4d93-b4c5-c2dd87449adb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:48 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072" returned: 0 in 0.511s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:48 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072 Aug 17 16:26:48 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:49 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:49 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:49 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3.b7d7547d-9b84-46cb-90e3-0fa04d071072" returned: 0 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-b7d7547d-9b84-46cb-90e3-0fa04d071072" released by "_delete_snapshot" :: held 2.780s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" released by "delete_snapshot" :: held 2.843s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:49 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.411s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f63ca4b-057b-439f-a438-247ad2e36451 tempest-GroupSnapshotsV319Test-2074726126 None] Delete group completed successfully. Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['1b8e979a-468e-4990-85c8-94b3434ded7a', '9a4a2e93-710a-42b0-8eb3-0c70a5fb9f26', '452102ae-b606-4e5a-9dd9-7522d2d9bbd7', 'cb87f2b9-2010-4c2b-93ea-34e9607d8981'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "cinder-ec427260-68b8-4351-87fb-8dff122c5070-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-ec427260-68b8-4351-87fb-8dff122c5070-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "cinder-quobyte-ec427260-68b8-4351-87fb-8dff122c5070" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-quobyte-ec427260-68b8-4351-87fb-8dff122c5070" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Delete snapshot completed successfully. Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99442f47-feba-4f1c-b35b-836b8223145e tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-b7d7547d-9b84-46cb-90e3-0fa04d071072-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f423d-9fde-4b88-86b1-bb33b13e9f92]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:49 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 Aug 17 16:26:49 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:50 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070" returned: 0 in 0.519s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:50 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070 Aug 17 16:26:50 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:50 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ec427260-68b8-4351-87fb-8dff122c5070" returned: 0 in 0.508s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-quobyte-ec427260-68b8-4351-87fb-8dff122c5070" released by "delete_volume" :: held 1.160s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (3c538d40-b40b-4a73-a657-913f8fb203f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe4fe98-4efb-4da7-9cd9-398e56fa44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe4fe98-4efb-4da7-9cd9-398e56fa44b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1840308420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d733b0-abbd-4a8a-aa07-84e8294942c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:51Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a97e18-907a-4e7a-a6bf-60a5208e0e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a97e18-907a-4e7a-a6bf-60a5208e0e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129ce9e-c39c-4efc-a8f3-2c41e8dca425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5129ce9e-c39c-4efc-a8f3-2c41e8dca425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d733b0-abbd-4a8a-aa07-84e8294942c4', 'volume_name': 'volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de37ab23-a5c6-4d2c-b4f7-67f7b05aed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de37ab23-a5c6-4d2c-b4f7-67f7b05aed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314089a4-53c2-4847-82dd-ad45102dd65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:51 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Volume f9d733b0-abbd-4a8a-aa07-84e8294942c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4', 'volume_size': 1} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1840308420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d733b0-abbd-4a8a-aa07-84e8294942c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:51Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Creating volume f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:51 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Created reservations ['3da54679-6838-4dc9-ac0f-620c86af9458', '044abe64-22bb-4896-8c76-633962f0c70b', '2e8c4de5-acf5-4439-95bd-f11bb47640ca', '82c5bec8-4723-4a4a-a53f-1c51c51d951c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:51 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 1073741824 Aug 17 16:26:51 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:51 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:51 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:51 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.380s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Deleted volume successfully. Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-db73a2e5-78b7-4a1f-80c3-33329b8188b2 tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-ec427260-68b8-4351-87fb-8dff122c5070-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:51 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 1073741824" returned: 0 in 0.781s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:52 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:26:52 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:52 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.566s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314089a4-53c2-4847-82dd-ad45102dd65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7017c1-a4ef-4355-a43f-0d89316a45a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Volume volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 (f9d733b0-abbd-4a8a-aa07-84e8294942c4): created successfully Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7017c1-a4ef-4355-a43f-0d89316a45a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (3c538d40-b40b-4a73-a657-913f8fb203f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:52 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-49ba96ec-6b86-48c8-af14-cb11e25278ed tempest-VolumesSnapshotTestJSON-855968631 None] Created volume successfully. Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Flow 'volume_create_manager' (82c76302-92b1-4fbd-88dd-73d5df3adc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0f437-788e-4258-9f83-3c90c72a8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea0f437-788e-4258-9f83-3c90c72a8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1284840243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc7a6d5-58a1-4c94-aa34-2af817e4e351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c03b5400ac4d09a748f5dbddfb9b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:53Z,use_quota=True,user_id='c49ff4dd4d964a5496d9040a7aed3500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e664f5d-3a9f-494a-8612-6e934c0b92f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e664f5d-3a9f-494a-8612-6e934c0b92f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0856750-55cf-4258-ad60-cede273e76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0856750-55cf-4258-ad60-cede273e76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc7a6d5-58a1-4c94-aa34-2af817e4e351', 'volume_name': 'volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dcdb18-1f0b-4784-8856-a1b9d59832d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dcdb18-1f0b-4784-8856-a1b9d59832d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d395349e-6c18-428b-8824-4c7effd858a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:52 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Volume 0fc7a6d5-58a1-4c94-aa34-2af817e4e351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351', 'volume_size': 1} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1284840243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc7a6d5-58a1-4c94-aa34-2af817e4e351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60c03b5400ac4d09a748f5dbddfb9b4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:26:53Z,use_quota=True,user_id='c49ff4dd4d964a5496d9040a7aed3500',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Creating volume 0fc7a6d5-58a1-4c94-aa34-2af817e4e351 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:52 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:26:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:53 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 1073741824 Aug 17 16:26:53 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:53 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 1073741824" returned: 0 in 0.727s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:53 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 Aug 17 16:26:53 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:54 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" returned: 0 in 0.404s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.842s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d395349e-6c18-428b-8824-4c7effd858a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5674b5-2975-48c6-8c4f-5329b538d3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Creating offline snapshot 6a010bc8-b317-43f6-983b-bc47c7cdb251 of volume f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:26:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Volume volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 (0fc7a6d5-58a1-4c94-aa34-2af817e4e351): created successfully Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5674b5-2975-48c6-8c4f-5329b538d3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Flow 'volume_create_manager' (82c76302-92b1-4fbd-88dd-73d5df3adc52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a697f-ed5f-4a59-9937-a4eb77563554]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0320d622-2d2e-41ed-9bcc-a1f477e2197b tempest-VolumesTransfersV357Test-1368511607 None] Created volume successfully. Aug 17 16:26:54 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:26:54 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:54 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.605s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:54 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 1G Aug 17 16:26:54 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "cinder-0fc7a6d5-58a1-4c94-aa34-2af817e4e351-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-0fc7a6d5-58a1-4c94-aa34-2af817e4e351-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "cinder-quobyte-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-quobyte-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9d60ce-2d3a-4185-a9ca-c8ccba2d8a02]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:55 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 1G" returned: 0 in 0.756s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:55 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:26:55 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:55 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 Aug 17 16:26:55 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:56 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.479s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:56 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 is being set with open permissions: ugo+rw Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:56 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:26:56 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:56 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" returned: 0 in 0.679s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:56 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351 Aug 17 16:26:56 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:56 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:56 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info Aug 17 16:26:56 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:56 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-quobyte-0fc7a6d5-58a1-4c94-aa34-2af817e4e351" released by "delete_volume" :: held 1.156s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Created reservations ['456a1f9f-bffe-46d1-b1be-a621a9251014', '2055ca25-3f04-4cba-a25a-353087dc01c5', '89ee650e-c509-4499-a836-2d8dd2a6241e', 'fceb6da8-4f63-4abb-8a57-e2e9c226d644'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:56 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:26:56 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:57 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:57 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info is being set with open permissions: ugo+rw Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:26:57 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info Aug 17 16:26:57 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:26:57 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.419s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:26:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Deleted volume successfully. Aug 17 16:26:57 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.info" returned: 0 in 0.406s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e7489bda-4693-4834-bf68-8a5a2ec08ebc tempest-VolumesTransfersV357Test-1886529502 None] Lock "cinder-0fc7a6d5-58a1-4c94-aa34-2af817e4e351-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:26:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-faa94c91-f79c-4d54-b09b-9f65ea98de3c tempest-VolumesSnapshotTestJSON-855968631 None] Create snapshot completed successfully Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (87108f89-a546-4f70-bdde-5978fbfa1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51a8b89-e353-40ef-bfa2-9a0abfb898a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51a8b89-e353-40ef-bfa2-9a0abfb898a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1730501267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf94e29-af4d-4ae1-bef1-96a0fc060c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6a010bc8-b317-43f6-983b-bc47c7cdb251,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:00Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1dd04-f2e4-45c4-b358-e6cc507d1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1dd04-f2e4-45c4-b358-e6cc507d1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053870ff-86be-4c7a-9242-77e9a751d2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053870ff-86be-4c7a-9242-77e9a751d2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dcf94e29-af4d-4ae1-bef1-96a0fc060c13', 'volume_name': 'volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13', 'volume_size': 2, 'snapshot_id': '6a010bc8-b317-43f6-983b-bc47c7cdb251'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d94e5ae-5580-4124-95fe-bff4caa07e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d94e5ae-5580-4124-95fe-bff4caa07e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea077ee-fa59-4605-a59b-8b1277df9d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:26:59 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Volume dcf94e29-af4d-4ae1-bef1-96a0fc060c13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13', 'volume_size': 2, 'snapshot_id': '6a010bc8-b317-43f6-983b-bc47c7cdb251'} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Creating volume dcf94e29-af4d-4ae1-bef1-96a0fc060c13 from snapshot 6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] snapshot: 6a010bc8-b317-43f6-983b-bc47c7cdb251, volume: dcf94e29-af4d-4ae1-bef1-96a0fc060c13, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[654c5238-fb48-4489-a1d1-e85088ec4949]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:26:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:00 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:27:00 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:00 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.637s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:00 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac4baed-9800-4767-95fe-63438d3d0ec0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:00 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:27:00 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:01 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.509s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:27:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:27:01 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:27:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:01 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 Aug 17 16:27:01 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:07 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" returned: 0 in 6.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:27:07 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Converted 1024.00 MB image at 161.94 MB/s Aug 17 16:27:07 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 is being set with open permissions: ugo+rw Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:07 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 Aug 17 16:27:07 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:07 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" released by "_copy_volume_from_snapshot" :: held 7.909s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" released by "_create_volume_from_snapshot" :: held 8.034s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.059s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea077ee-fa59-4605-a59b-8b1277df9d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13', 'volume_size': 2, 'snapshot_id': '6a010bc8-b317-43f6-983b-bc47c7cdb251'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a718e16e-c82b-4422-b365-acfe8e46d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:07 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Volume volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 (dcf94e29-af4d-4ae1-bef1-96a0fc060c13): created successfully Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a718e16e-c82b-4422-b365-acfe8e46d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (87108f89-a546-4f70-bdde-5978fbfa1167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1f3b93a1-5d1f-4996-a6a5-dcf63969c52d tempest-VolumesSnapshotTestJSON-855968631 None] Created volume successfully. Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-dcf94e29-af4d-4ae1-bef1-96a0fc060c13-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-dcf94e29-af4d-4ae1-bef1-96a0fc060c13-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d94c604-a7ff-414c-85df-ff17b6f4d54f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:09 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 Aug 17 16:27:09 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:09 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" returned: 0 in 0.594s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:09 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13 Aug 17 16:27:09 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:09 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-dcf94e29-af4d-4ae1-bef1-96a0fc060c13" released by "delete_volume" :: held 0.980s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['4cb5d6df-092b-4720-8eb6-fe7e9139c930', '14e17f4f-c187-48f2-ad48-ef42cab6ddb7', 'a0cee953-042c-4e40-a0be-fb7f1ef318d7', 'f6c5c36a-e11c-4d91-93a9-a30ecef9285c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:10 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:10 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:10 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Deleted volume successfully. Aug 17 16:27:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-069c0d52-288a-41f4-9e86-773d1cd8f35f tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-dcf94e29-af4d-4ae1-bef1-96a0fc060c13-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-6a010bc8-b317-43f6-983b-bc47c7cdb251-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-6a010bc8-b317-43f6-983b-bc47c7cdb251-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Deleting offline snapshot 6a010bc8-b317-43f6-983b-bc47c7cdb251 of volume f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] snapshot_file for this snap is: volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f12801-c3e8-4d20-9c06-3e92cf1b1936]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:11 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:27:11 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:11 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.565s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128825b-5042-47f2-ae03-db8e71f40019]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:12 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:27:12 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Flow 'volume_create_manager' (f6f846d2-15a1-458a-bb3c-535310a4d06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3ec95e-686e-4846-82ae-b6b968c860f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b3ec95e-686e-4846-82ae-b6b968c860f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1987980181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5b2b9f-236c-4828-b402-8d85ac99baa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2811847b1441a7b840a0665a9000d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:13Z,use_quota=True,user_id='4ff6be4c2b8f4347bd437a7a70a97e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319a384f-1f98-4b81-82eb-5ac16e3df857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319a384f-1f98-4b81-82eb-5ac16e3df857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34e784b-6aa2-4bb2-9c7f-9f6c614616e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b34e784b-6aa2-4bb2-9c7f-9f6c614616e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5b2b9f-236c-4828-b402-8d85ac99baa6', 'volume_name': 'volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233f2368-baf6-4794-9310-6e5e0fca3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233f2368-baf6-4794-9310-6e5e0fca3b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce071d93-ce0f-4b73-b086-aaaa3ce53d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:12 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume 1c5b2b9f-236c-4828-b402-8d85ac99baa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6', 'volume_size': 1} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1987980181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5b2b9f-236c-4828-b402-8d85ac99baa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2811847b1441a7b840a0665a9000d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:13Z,use_quota=True,user_id='4ff6be4c2b8f4347bd437a7a70a97e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Creating volume 1c5b2b9f-236c-4828-b402-8d85ac99baa6 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:12 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:12 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.929s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:12 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 1073741824 Aug 17 16:27:12 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:12 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:27:12 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Flow 'volume_create_manager' (adcfa41e-36bc-4970-aa78-a8dff57d94dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9ea3a-3209-4656-8209-cca160db10e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:13 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.567s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:13 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251 Aug 17 16:27:13 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e9ea3a-3209-4656-8209-cca160db10e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-718118688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8913bf97-28d2-4c23-bf60-2e5a882b9322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2811847b1441a7b840a0665a9000d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:13Z,use_quota=True,user_id='4ff6be4c2b8f4347bd437a7a70a97e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c4f7a-58c5-4234-8c32-e4a4e23454f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0c4f7a-58c5-4234-8c32-e4a4e23454f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f629bdc8-5413-4216-b962-d6c2160d89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f629bdc8-5413-4216-b962-d6c2160d89a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8913bf97-28d2-4c23-bf60-2e5a882b9322', 'volume_name': 'volume-8913bf97-28d2-4c23-bf60-2e5a882b9322', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f2ccfa-0e7b-4bcd-8397-ce135d5cbf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5f2ccfa-0e7b-4bcd-8397-ce135d5cbf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cbca21-c478-4941-9719-81b15b62437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:13 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume 8913bf97-28d2-4c23-bf60-2e5a882b9322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8913bf97-28d2-4c23-bf60-2e5a882b9322', 'volume_size': 1} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:13 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 1073741824" returned: 0 in 0.817s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:13 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 Aug 17 16:27:13 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:13 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4.6a010bc8-b317-43f6-983b-bc47c7cdb251" returned: 0 in 0.431s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a010bc8-b317-43f6-983b-bc47c7cdb251" released by "_delete_snapshot" :: held 2.722s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" released by "delete_snapshot" :: held 2.754s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['817c2d9b-27a0-4ee8-b92c-c858ae19d7ac', '27817269-2316-43c5-b0a1-d0408221a770', '418e6fd8-5d37-470b-beae-d1269b20a011', '250056b6-4413-4044-a965-02cf94ee44de'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:14 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6" returned: 0 in 0.464s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-718118688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8913bf97-28d2-4c23-bf60-2e5a882b9322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2811847b1441a7b840a0665a9000d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:13Z,use_quota=True,user_id='4ff6be4c2b8f4347bd437a7a70a97e6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Creating volume 8913bf97-28d2-4c23-bf60-2e5a882b9322 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:14 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:14 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 1073741824 Aug 17 16:27:14 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce071d93-ce0f-4b73-b086-aaaa3ce53d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a85f180-85c7-445a-a67c-a7a4c3a0e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Delete snapshot completed successfully. Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0474b8d9-35e0-4144-84b4-8cb85dc94f14 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-6a010bc8-b317-43f6-983b-bc47c7cdb251-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:14 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 (1c5b2b9f-236c-4828-b402-8d85ac99baa6): created successfully Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a85f180-85c7-445a-a67c-a7a4c3a0e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Flow 'volume_create_manager' (f6f846d2-15a1-458a-bb3c-535310a4d06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-86008ab0-12dc-4742-91c5-4d9cb0ae83ec tempest-TestServerVolumeAttachmentScenario-593162091 None] Created volume successfully. Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (64e6c7b1-df8f-49db-a50b-a0c85eadc040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cea8912-89a8-40c7-b976-45ce7910d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cea8912-89a8-40c7-b976-45ce7910d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647179137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbb9795-8e2d-41b1-a5dc-0372347abb02,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:14Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88ad53f-480b-47fb-bf32-108981b298f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88ad53f-480b-47fb-bf32-108981b298f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b626f04-7db2-462f-ab83-6ae06634b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b626f04-7db2-462f-ab83-6ae06634b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbb9795-8e2d-41b1-a5dc-0372347abb02', 'volume_name': 'volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5567e8e-f91f-43ca-8f81-bde3febd1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5567e8e-f91f-43ca-8f81-bde3febd1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db36b32-c202-4f13-895f-089c972e9b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:14 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Volume 3fbb9795-8e2d-41b1-a5dc-0372347abb02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02', 'volume_size': 1} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-f9d733b0-abbd-4a8a-aa07-84e8294942c4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-f9d733b0-abbd-4a8a-aa07-84e8294942c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b657569-2789-4451-bc60-bc78eea355a9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:14 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:27:14 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:14 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 1073741824" returned: 0 in 0.784s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:15 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 Aug 17 16:27:15 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:15 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.586s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:15 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4 Aug 17 16:27:15 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:15 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-647179137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbb9795-8e2d-41b1-a5dc-0372347abb02,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:14Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Creating volume 3fbb9795-8e2d-41b1-a5dc-0372347abb02 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24cbca21-c478-4941-9719-81b15b62437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8913bf97-28d2-4c23-bf60-2e5a882b9322', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:15 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 1073741824 Aug 17 16:27:15 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06376737-2a49-4159-8e70-3da1ca10d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Volume volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 (8913bf97-28d2-4c23-bf60-2e5a882b9322): created successfully Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06376737-2a49-4159-8e70-3da1ca10d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Flow 'volume_create_manager' (adcfa41e-36bc-4970-aa78-a8dff57d94dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4d3dcf7b-251a-484c-b940-867450404fa7 tempest-TestServerVolumeAttachmentScenario-593162091 None] Created volume successfully. Aug 17 16:27:15 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f9d733b0-abbd-4a8a-aa07-84e8294942c4" returned: 0 in 0.342s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-f9d733b0-abbd-4a8a-aa07-84e8294942c4" released by "delete_volume" :: held 1.026s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0e68194b-cbd0-4779-815c-cd04e9b29112 tempest-GroupsTest-1357846312 None] Group tempest-Group1-280524854: creating Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['b94798d5-8743-46f0-9b3a-abc87bb4e441', '22c48035-cd5a-47ac-9a25-1c01737c2329', '7a1a896f-84b8-4437-853f-9c36f33420a2', '83ce5d71-2fa3-4243-95e7-7b3bc3c13a67'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0e68194b-cbd0-4779-815c-cd04e9b29112 tempest-GroupsTest-1357846312 None] Group tempest-Group1-280524854: created successfully Aug 17 16:27:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0e68194b-cbd0-4779-815c-cd04e9b29112 tempest-GroupsTest-1357846312 None] Create group completed successfully. Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:15 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:15 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:16 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 1073741824" returned: 0 in 0.687s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:16 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 Aug 17 16:27:16 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:16 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.311s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:16 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Deleted volume successfully. Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1cb8d20-b8cb-4ce9-af09-a27afdb69dc2 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-f9d733b0-abbd-4a8a-aa07-84e8294942c4-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:16 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02" returned: 0 in 0.316s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db36b32-c202-4f13-895f-089c972e9b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c5f461-6ac9-4a2b-84de-a0fa1ee8aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:16 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Volume volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 (3fbb9795-8e2d-41b1-a5dc-0372347abb02): created successfully Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c5f461-6ac9-4a2b-84de-a0fa1ee8aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (64e6c7b1-df8f-49db-a50b-a0c85eadc040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:16 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-48a54247-8aa8-4732-830e-5954423976b4 tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:27:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-76f93565-e075-463e-b71d-c09a2017a5a6 tempest-GroupsTest-1357846312 None] Group tempest-Group2-470577704: creating Aug 17 16:27:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-76f93565-e075-463e-b71d-c09a2017a5a6 tempest-GroupsTest-1357846312 None] Group tempest-Group2-470577704: created successfully Aug 17 16:27:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-76f93565-e075-463e-b71d-c09a2017a5a6 tempest-GroupsTest-1357846312 None] Create group completed successfully. Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (e282cb5d-f94e-4506-ad60-473e931e23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e5cb83-274a-4463-8607-a4c94fb6cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e5cb83-274a-4463-8607-a4c94fb6cef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737923260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6293727-7085-43da-b99f-771c742d159f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:18Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e40592-2179-437e-9cfa-14e36d3f9bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5e40592-2179-437e-9cfa-14e36d3f9bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41860cf7-39f0-4d24-9d44-32ec0fa94343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41860cf7-39f0-4d24-9d44-32ec0fa94343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6293727-7085-43da-b99f-771c742d159f', 'volume_name': 'volume-d6293727-7085-43da-b99f-771c742d159f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb8481-6fe7-49bd-940b-aaba7ee19abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2bb8481-6fe7-49bd-940b-aaba7ee19abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43d7a8a-bb27-4ae2-9fc0-14b591f886a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:17 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Volume d6293727-7085-43da-b99f-771c742d159f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6293727-7085-43da-b99f-771c742d159f', 'volume_size': 1} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737923260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6293727-7085-43da-b99f-771c742d159f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:18Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Creating volume d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:17 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:17 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f 1073741824 Aug 17 16:27:17 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:18 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f 1073741824" returned: 0 in 0.726s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:18 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:18 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (eb3f003b-a417-471a-8ceb-a607484438c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154d23c-ad1c-4455-88e3-bd5c098f2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e154d23c-ad1c-4455-88e3-bd5c098f2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-368417547',display_name='tempest-VolumesGetTest-Volume-1370530592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1145f194-2dc8-4672-bde3-6b1e674ab37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:19Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40fe574-ac5d-4016-9fee-1c6ab131ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40fe574-ac5d-4016-9fee-1c6ab131ac94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5672987-b1cb-430f-b57b-e92a11571f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5672987-b1cb-430f-b57b-e92a11571f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1145f194-2dc8-4672-bde3-6b1e674ab37a', 'volume_name': 'volume-1145f194-2dc8-4672-bde3-6b1e674ab37a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5bc6a0-d486-4449-99b1-0bd8aff86ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5bc6a0-d486-4449-99b1-0bd8aff86ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514a3cb6-2bb5-4a99-a295-4f13587086ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:18 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Volume 1145f194-2dc8-4672-bde3-6b1e674ab37a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1145f194-2dc8-4672-bde3-6b1e674ab37a', 'volume_size': 1} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:18 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.241s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-368417547',display_name='tempest-VolumesGetTest-Volume-1370530592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1145f194-2dc8-4672-bde3-6b1e674ab37a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:19Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Creating volume 1145f194-2dc8-4672-bde3-6b1e674ab37a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:18 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:19 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a 1073741824 Aug 17 16:27:19 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a43d7a8a-bb27-4ae2-9fc0-14b591f886a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6293727-7085-43da-b99f-771c742d159f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a43e470-4c14-4f74-9782-5d1728a08e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Volume volume-d6293727-7085-43da-b99f-771c742d159f (d6293727-7085-43da-b99f-771c742d159f): created successfully Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a43e470-4c14-4f74-9782-5d1728a08e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (e282cb5d-f94e-4506-ad60-473e931e23c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:19 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-73e92608-78e6-4e99-8621-b2492f54cf23 tempest-VolumesSnapshotTestJSON-855968631 None] Created volume successfully. Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (470c6fe6-7d25-4768-8640-90466097761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9641b705-14cd-4daf-8ce1-c7a573cd8bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9641b705-14cd-4daf-8ce1-c7a573cd8bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421652722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fc30373-d2de-4e1d-8c2b-82fe49d80fd4,host='devstack@QuobyteHD#QuobyteHD',id=7b9d16e5-c6fb-4044-bab0-4f884a91fb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:19Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(702e80eb-ad69-4b39-ae45-fe56390423ad),volume_type_id=702e80eb-ad69-4b39-ae45-fe56390423ad)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd0403c-9774-45e3-a853-54d463b5cc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dd0403c-9774-45e3-a853-54d463b5cc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63519ba-fe1f-4cbf-b356-92f32e7f9950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63519ba-fe1f-4cbf-b356-92f32e7f9950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9d16e5-c6fb-4044-bab0-4f884a91fb21', 'volume_name': 'volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c232a1-6875-4c5f-a69a-a3023ac981fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c232a1-6875-4c5f-a69a-a3023ac981fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c1a981-7218-472e-8c44-884ed1d4b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Volume 7b9d16e5-c6fb-4044-bab0-4f884a91fb21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21', 'volume_size': 1} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:19 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a 1073741824" returned: 0 in 0.703s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:19 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a Aug 17 16:27:19 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:20 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fc30373-d2de-4e1d-8c2b-82fe49d80fd4,created_at=2026-08-17T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1421652722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fc30373-d2de-4e1d-8c2b-82fe49d80fd4,host='devstack@QuobyteHD#QuobyteHD',id=7b9d16e5-c6fb-4044-bab0-4f884a91fb21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:19Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(702e80eb-ad69-4b39-ae45-fe56390423ad),volume_type_id=702e80eb-ad69-4b39-ae45-fe56390423ad)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Creating volume 7b9d16e5-c6fb-4044-bab0-4f884a91fb21 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:20 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514a3cb6-2bb5-4a99-a295-4f13587086ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1145f194-2dc8-4672-bde3-6b1e674ab37a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:20 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 1073741824 Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3648fc2-a187-49f6-87af-dc6e78a9a1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:20 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Volume volume-1145f194-2dc8-4672-bde3-6b1e674ab37a (1145f194-2dc8-4672-bde3-6b1e674ab37a): created successfully Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3648fc2-a187-49f6-87af-dc6e78a9a1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (eb3f003b-a417-471a-8ceb-a607484438c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-da85d860-5225-4ff0-b90a-82670c7bcded tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:27:20 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-1145f194-2dc8-4672-bde3-6b1e674ab37a-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 1073741824" returned: 0 in 0.832s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "cinder-1145f194-2dc8-4672-bde3-6b1e674ab37a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:21 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-1145f194-2dc8-4672-bde3-6b1e674ab37a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:21 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-1145f194-2dc8-4672-bde3-6b1e674ab37a" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9cfdb-bce0-4606-a49a-f68dd92ee81d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:21 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a Aug 17 16:27:21 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:21 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.352s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Creating offline snapshot a20ab8db-f290-4a59-8a64-1ade46f5aa80 of volume d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c1a981-7218-472e-8c44-884ed1d4b683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83079628-d896-420a-af2b-0c084f2103ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6570d9-1ed6-4594-ac7d-67a52c1bbefd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Volume volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 (7b9d16e5-c6fb-4044-bab0-4f884a91fb21): created successfully Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83079628-d896-420a-af2b-0c084f2103ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (470c6fe6-7d25-4768-8640-90466097761b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d8e9548b-f643-4a48-b69c-12954947f1d9 tempest-GroupsTest-1357846312 None] Created volume successfully. Aug 17 16:27:21 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:21 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:21 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:21 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a Aug 17 16:27:21 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:21 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:21 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1145f194-2dc8-4672-bde3-6b1e674ab37a" returned: 0 in 0.402s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:21 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 1G Aug 17 16:27:21 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-1145f194-2dc8-4672-bde3-6b1e674ab37a" released by "delete_volume" :: held 0.894s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Created reservations ['0b317ba5-21d6-4741-b727-13e54cc87aac', '978b133d-9ab7-44ec-8ace-301732447c03', '6036215d-2dd6-4111-8bd5-927615327c5d', 'fd7f32ad-49d6-468a-ba4d-a900712f9a23'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:22 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:22 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Acquiring lock "cinder-quobyte-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:22 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:22 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 1G" returned: 0 in 0.730s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.412s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6293727-7085-43da-b99f-771c742d159f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac8b720-028b-44ef-bf6b-16d23d50ed4d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:27:22 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6293727-7085-43da-b99f-771c742d159f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:22 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b1d7cfd6-387b-4873-974a-775d9d69805a tempest-VolumesGetTest-1899419658 None] Lock "cinder-1145f194-2dc8-4672-bde3-6b1e674ab37a-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:22 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 Aug 17 16:27:22 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:23 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6293727-7085-43da-b99f-771c742d159f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.430s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:23 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 is being set with open permissions: ugo+rw Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:23 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:23 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" returned: 0 in 0.519s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:23 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:23 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21 Aug 17 16:27:23 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-3fbb9795-8e2d-41b1-a5dc-0372347abb02-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "cinder-3fbb9795-8e2d-41b1-a5dc-0372347abb02-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:23 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.682s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-3fbb9795-8e2d-41b1-a5dc-0372347abb02" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-3fbb9795-8e2d-41b1-a5dc-0372347abb02" acquired by "delete_volume" :: waited 0.045s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:23 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" returned: 0 in 0.738s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:23 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info Aug 17 16:27:23 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-7b9d16e5-c6fb-4044-bab0-4f884a91fb21" released by "delete_volume" :: held 1.342s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c604e5-2e8d-45a5-a326-63d394b05783]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Created reservations ['5556bfe0-5a9c-48d9-a494-ceaece2eef50'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:24 devstack cinder-volume[94468]: WARNING cinder.quota [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1940630044 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1940630044, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:27:24 devstack cinder-volume[94468]: WARNING cinder.quota [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1940630044 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1940630044, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Created reservations ['94362da5-5b65-4cca-8d9b-7581620d4cf5', '063762d0-2721-48bf-b92f-f94ea24a28ed', 'a37b24ef-897d-4ae7-8e89-cb8f975d7b85', 'c4731bfa-f2c8-43df-8476-12299f57e5fe'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:24 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 Aug 17 16:27:24 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=134,cinder:UPDATE=127,cinder:INSERT=39,cinder:DELETE=13 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:24 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:24 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:24 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info" returned: 0 in 0.784s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:24 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info is being set with open permissions: ugo+rw Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:24 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info Aug 17 16:27:24 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:24 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02" returned: 0 in 0.952s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:24 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02 Aug 17 16:27:24 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:25 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.info" returned: 0 in 0.352s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.712s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=130,cinder:UPDATE=163,cinder:INSERT=41,cinder:DELETE=9 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:27:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e028f996-26a1-45cc-a6d6-f380f2765908 tempest-VolumesSnapshotTestJSON-855968631 None] Create snapshot completed successfully Aug 17 16:27:25 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.669s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a6672471-f9dc-4b6e-a09d-9f4acfa92ce9 tempest-GroupsTest-1357846312 None] Delete group completed successfully. Aug 17 16:27:25 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3fbb9795-8e2d-41b1-a5dc-0372347abb02" returned: 0 in 0.481s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-3fbb9795-8e2d-41b1-a5dc-0372347abb02" released by "delete_volume" :: held 1.539s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Created reservations ['02a3d6b3-9a60-48cd-aeaa-f1ad803e270d', '4ded77e9-8e6d-4480-b905-f5f9125ddb98', '2d0d32de-9b2c-4515-85ab-ad304c5b5e73', '69b600f3-a0d1-4eaa-b2a5-7c17b1ec2c3d'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Created reservations ['cc8882a9-7397-453b-9aa3-21f7fce17f59'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_db.api [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Aug 17 16:27:25 devstack cinder-volume[94468]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at Aug 17 16:27:25 devstack cinder-volume[94468]: FROM reservations Aug 17 16:27:25 devstack cinder-volume[94468]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE] Aug 17 16:27:25 devstack cinder-volume[94468]: [parameters: {'uuid_1_1': '02a3d6b3-9a60-48cd-aeaa-f1ad803e270d', 'uuid_1_2': '4ded77e9-8e6d-4480-b905-f5f9125ddb98', 'uuid_1_3': '2d0d32de-9b2c-4515-85ab-ad304c5b5e73', 'uuid_1_4': '69b600f3-a0d1-4eaa-b2a5-7c17b1ec2c3d'}] Aug 17 16:27:25 devstack cinder-volume[94468]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=94468) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_db.api [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=94468) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:25 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:25 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:26 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.351s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-27b8db24-b0ac-4a75-8835-64643540894f tempest-GroupsTest-1357846312 None] Delete group completed successfully. Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (1f972456-c408-4e13-8d70-69ed8d58fa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7021a7-d402-4ca4-b3ec-9fdab49d3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7021a7-d402-4ca4-b3ec-9fdab49d3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-365053167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857861fe-258b-4516-ada8-61d6c44bfafb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08380e74f1cf4f50b634fb1e1ac6b488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a20ab8db-f290-4a59-8a64-1ade46f5aa80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:26Z,use_quota=True,user_id='b8409e78f2874ac28590179be4e39c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a2a6b-19b0-4fac-b061-b0fe007275f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1a2a6b-19b0-4fac-b061-b0fe007275f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b68efbd-98ff-49ed-ad50-70dfa3c6632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b68efbd-98ff-49ed-ad50-70dfa3c6632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '857861fe-258b-4516-ada8-61d6c44bfafb', 'volume_name': 'volume-857861fe-258b-4516-ada8-61d6c44bfafb', 'volume_size': 1, 'snapshot_id': 'a20ab8db-f290-4a59-8a64-1ade46f5aa80'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d7cc18-d762-4d1b-9d94-073e33297d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d7cc18-d762-4d1b-9d94-073e33297d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0648e51-fe72-482c-9036-6e0e391e03f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Volume 857861fe-258b-4516-ada8-61d6c44bfafb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-857861fe-258b-4516-ada8-61d6c44bfafb', 'volume_size': 1, 'snapshot_id': 'a20ab8db-f290-4a59-8a64-1ade46f5aa80'} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80-857861fe-258b-4516-ada8-61d6c44bfafb" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80-857861fe-258b-4516-ada8-61d6c44bfafb" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Creating volume 857861fe-258b-4516-ada8-61d6c44bfafb from snapshot a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] snapshot: a20ab8db-f290-4a59-8a64-1ade46f5aa80, volume: 857861fe-258b-4516-ada8-61d6c44bfafb, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee174133-a89a-49bd-8772-dfd5d99edfd6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:26 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:26 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:26 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:26 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:26 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (f2f96a65-3a9c-4d06-b016-8a163de89562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9564b5db-35a8-49ed-8b01-276d4111b5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9564b5db-35a8-49ed-8b01-276d4111b5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-882687139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9baac6-4f79-4f10-b86c-49ddb439894f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:27Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f37fd75-5209-4fbf-a033-49c03b67100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f37fd75-5209-4fbf-a033-49c03b67100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a30d5ef-3644-4fe3-8af0-09fe675c8851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a30d5ef-3644-4fe3-8af0-09fe675c8851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9baac6-4f79-4f10-b86c-49ddb439894f', 'volume_name': 'volume-7b9baac6-4f79-4f10-b86c-49ddb439894f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c726b34-e61a-4f19-b22c-3241bdfab901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c726b34-e61a-4f19-b22c-3241bdfab901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfa7f1e-5e90-4304-84ec-9b8b665f01b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Volume 7b9baac6-4f79-4f10-b86c-49ddb439894f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9baac6-4f79-4f10-b86c-49ddb439894f', 'volume_size': 1} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:27 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.855s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6293727-7085-43da-b99f-771c742d159f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ef266-fa1a-45c4-a1eb-b51ed79aad14]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:27 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.738s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:27:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-032dab18-0c9d-462b-ae0a-548c2e094a90 tempest-VolumesGetTest-1899419658 None] Lock "cinder-3fbb9795-8e2d-41b1-a5dc-0372347abb02-delete_volume" released by "delete_volume" :: held 3.840s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:27 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:27 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f7aaea4-382a-4dc7-89f0-605dab90dab3 tempest-GroupsTest-1357846312 None] Group tempest-GroupsTest-Group-1836211522: creating Aug 17 16:27:28 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 0.623s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:27:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:27:28 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:27:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:28 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb Aug 17 16:27:28 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f7aaea4-382a-4dc7-89f0-605dab90dab3 tempest-GroupsTest-1357846312 None] Group tempest-GroupsTest-Group-1836211522: created successfully Aug 17 16:27:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f7aaea4-382a-4dc7-89f0-605dab90dab3 tempest-GroupsTest-1357846312 None] Create group completed successfully. Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (8055c5aa-b307-41c8-a7ba-427213ed71cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe1f8c-c114-462a-923f-7873f153487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbe1f8c-c114-462a-923f-7873f153487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907776721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,host='devstack@QuobyteHD#QuobyteHD',id=09768cef-021c-4f86-94b2-277e257d7312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:32Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6c4ac8-8936-44cf-a323-2981ba318b8a),volume_type_id=ee6c4ac8-8936-44cf-a323-2981ba318b8a)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f025d-e00e-457f-9788-842a081fa12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f025d-e00e-457f-9788-842a081fa12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1872569e-042c-463c-b3dc-44d569c7cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1872569e-042c-463c-b3dc-44d569c7cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09768cef-021c-4f86-94b2-277e257d7312', 'volume_name': 'volume-09768cef-021c-4f86-94b2-277e257d7312', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7282276-23de-4806-b23b-2f8ea19cf24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7282276-23de-4806-b23b-2f8ea19cf24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aad343-25e3-48b9-bc0f-37801af83902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Volume 09768cef-021c-4f86-94b2-277e257d7312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09768cef-021c-4f86-94b2-277e257d7312', 'volume_size': 1} Aug 17 16:27:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:35 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb" returned: 0 in 7.467s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:27:35 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Converted 1024.00 MB image at 137.12 MB/s Aug 17 16:27:35 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb is being set with open permissions: ugo+rw Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:35 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb Aug 17 16:27:35 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:35 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" released by "_copy_volume_from_snapshot" :: held 9.410s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80-857861fe-258b-4516-ada8-61d6c44bfafb" released by "_create_volume_from_snapshot" :: held 9.504s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.535s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.737s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-882687139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9baac6-4f79-4f10-b86c-49ddb439894f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:27Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Creating volume 7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:35 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:35 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f 1073741824 Aug 17 16:27:35 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0648e51-fe72-482c-9036-6e0e391e03f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857861fe-258b-4516-ada8-61d6c44bfafb', 'volume_size': 1, 'snapshot_id': 'a20ab8db-f290-4a59-8a64-1ade46f5aa80'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a47272e-6b35-4ead-854d-f9d408282f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:35 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Volume volume-857861fe-258b-4516-ada8-61d6c44bfafb (857861fe-258b-4516-ada8-61d6c44bfafb): created successfully Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a47272e-6b35-4ead-854d-f9d408282f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Flow 'volume_create_manager' (1f972456-c408-4e13-8d70-69ed8d58fa2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4caea385-6b1d-4dd8-b73e-20bb058e94e9 tempest-VolumesSnapshotTestJSON-855968631 None] Created volume successfully. Aug 17 16:27:36 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f 1073741824" returned: 0 in 0.534s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:36 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:36 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:36 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.286s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.672s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,created_at=2026-08-17T14:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907776721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,host='devstack@QuobyteHD#QuobyteHD',id=09768cef-021c-4f86-94b2-277e257d7312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:32Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6c4ac8-8936-44cf-a323-2981ba318b8a),volume_type_id=ee6c4ac8-8936-44cf-a323-2981ba318b8a)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Creating volume 09768cef-021c-4f86-94b2-277e257d7312 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:36 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:36 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 1073741824 Aug 17 16:27:36 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dfa7f1e-5e90-4304-84ec-9b8b665f01b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9baac6-4f79-4f10-b86c-49ddb439894f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b292fb-8e71-4378-8011-efa273654228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:36 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Volume volume-7b9baac6-4f79-4f10-b86c-49ddb439894f (7b9baac6-4f79-4f10-b86c-49ddb439894f): created successfully Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b292fb-8e71-4378-8011-efa273654228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (f2f96a65-3a9c-4d06-b016-8a163de89562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-49b296b8-6b42-4f93-a3c0-9805b9bed69e tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-857861fe-258b-4516-ada8-61d6c44bfafb-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-857861fe-258b-4516-ada8-61d6c44bfafb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[269357b3-a0b2-42a9-86e3-140fd5c18a1c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:37 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 1073741824" returned: 0 in 0.552s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:37 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 Aug 17 16:27:37 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:37 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb Aug 17 16:27:37 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:37 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34aad343-25e3-48b9-bc0f-37801af83902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09768cef-021c-4f86-94b2-277e257d7312', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971922a6-08cc-4234-881e-da53a8b697a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Volume volume-09768cef-021c-4f86-94b2-277e257d7312 (09768cef-021c-4f86-94b2-277e257d7312): created successfully Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971922a6-08cc-4234-881e-da53a8b697a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (8055c5aa-b307-41c8-a7ba-427213ed71cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7201955e-02ce-4173-9597-c5c6a5945a44 tempest-GroupsTest-1357846312 None] Created volume successfully. Aug 17 16:27:37 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb" returned: 0 in 0.572s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:37 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb Aug 17 16:27:37 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:38 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-857861fe-258b-4516-ada8-61d6c44bfafb" returned: 0 in 0.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (b01af026-b23b-4871-b6e7-7275b78839cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7d703a-ad6d-4b6c-b04c-da68fef9bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-857861fe-258b-4516-ada8-61d6c44bfafb" released by "delete_volume" :: held 0.969s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc7d703a-ad6d-4b6c-b04c-da68fef9bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-992245203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1c77d14-2958-4e83-9549-097617b99de9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7b9baac6-4f79-4f10-b86c-49ddb439894f,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:38Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f32b036-c614-4260-8901-fd9fb6423ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f32b036-c614-4260-8901-fd9fb6423ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46be4df8-f25a-4a8f-9b16-76d14eaee64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46be4df8-f25a-4a8f-9b16-76d14eaee64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b1c77d14-2958-4e83-9549-097617b99de9', 'volume_name': 'volume-b1c77d14-2958-4e83-9549-097617b99de9', 'volume_size': 1, 'source_volid': '7b9baac6-4f79-4f10-b86c-49ddb439894f', 'source_volstatus': 'available'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4794ae-3c71-471a-944a-7b8be89900c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4794ae-3c71-471a-944a-7b8be89900c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2148d6-cb4c-4985-bae3-5972dbdbdad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Volume b1c77d14-2958-4e83-9549-097617b99de9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b1c77d14-2958-4e83-9549-097617b99de9', 'volume_size': 1, 'source_volid': '7b9baac6-4f79-4f10-b86c-49ddb439894f', 'source_volstatus': 'available'} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:38 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Cloning volume 7b9baac6-4f79-4f10-b86c-49ddb439894f to volume b1c77d14-2958-4e83-9549-097617b99de9 Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Creating offline snapshot 96984f61-4948-428a-8421-cf2e7e7070aa of volume 7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['a91bcecf-7eef-4e51-90b0-6e4009e27367', '5f728673-7eb6-4a67-b73d-cb96988f4d4f', '3f5c47da-2952-43e7-babf-6cfd7650bf63', 'f2c6ff0c-87d6-4d16-b45e-c1963337a2d1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd7b51f-a214-41e0-8923-46d6c1ea5659]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:38 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:38 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:38 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:38 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.309s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:38 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.411s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Deleted volume successfully. Aug 17 16:27:38 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa 1G Aug 17 16:27:38 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-381d359b-6723-472b-a78f-c7b1b6383164 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-857861fe-258b-4516-ada8-61d6c44bfafb-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:39 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa 1G" returned: 0 in 0.503s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9baac6-4f79-4f10-b86c-49ddb439894f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:39 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9baac6-4f79-4f10-b86c-49ddb439894f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:39 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-a20ab8db-f290-4a59-8a64-1ade46f5aa80-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-a20ab8db-f290-4a59-8a64-1ade46f5aa80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (93eb8d95-a41a-4a77-bcf9-d18feca72180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa85c93-2a3f-4cc5-ad4b-8735c8f36e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Deleting offline snapshot a20ab8db-f290-4a59-8a64-1ade46f5aa80 of volume d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] snapshot_file for this snap is: volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa85c93-2a3f-4cc5-ad4b-8735c8f36e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078486006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,host='devstack@QuobyteHD#QuobyteHD',id=9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:39Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6c4ac8-8936-44cf-a323-2981ba318b8a),volume_type_id=ee6c4ac8-8936-44cf-a323-2981ba318b8a)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e129748-a7ac-4cfc-add0-7dc55cf1f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e129748-a7ac-4cfc-add0-7dc55cf1f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a26c69-53c5-4f44-9225-ccaf0d686fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a26c69-53c5-4f44-9225-ccaf0d686fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad', 'volume_name': 'volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767e8f95-6051-46ec-b8ef-3d91b67eb5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767e8f95-6051-46ec-b8ef-3d91b67eb5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc3364-6a6d-4fed-901a-e3bf13fb8716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Volume 9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad', 'volume_size': 1} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdb7e23-8fa4-47ec-bf09-78a07507c0fc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:39 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9baac6-4f79-4f10-b86c-49ddb439894f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.457s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:39 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa is being set with open permissions: ugo+rw Aug 17 16:27:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:39 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:39 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:39 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:39 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:40 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:40 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info Aug 17 16:27:40 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:40 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6293727-7085-43da-b99f-771c742d159f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cfba7-7172-4339-86d7-d38847ad2e1d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:40 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:40 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:40 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info" returned: 0 in 0.310s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:40 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info is being set with open permissions: ugo+rw Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:40 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info Aug 17 16:27:40 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:40 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.info" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] snapshot: 96984f61-4948-428a-8421-cf2e7e7070aa, volume: b1c77d14-2958-4e83-9549-097617b99de9, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df6033-1290-4cc9-86ea-bace3838aa05]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:40 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 0.597s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:40 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:40 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:40 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:40 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:41 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.398s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9baac6-4f79-4f10-b86c-49ddb439894f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9dadaa-cceb-4ebb-8cf9-88a0535d8bb6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:41 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:41 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80 Aug 17 16:27:41 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:41 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:41 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:41 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f.a20ab8db-f290-4a59-8a64-1ade46f5aa80" returned: 0 in 0.252s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-a20ab8db-f290-4a59-8a64-1ade46f5aa80" released by "_delete_snapshot" :: held 1.852s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" released by "delete_snapshot" :: held 1.926s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:41 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:41 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 Aug 17 16:27:41 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['7638b3c2-635a-4f1e-8d3b-6f4b828e8205', '7e9d364c-38a6-428e-b125-b1eac7f02d80', '36c09321-c405-47ed-b300-032fd9ec3472', '0edf1ae5-fcce-41ca-b6b2-97f2a93f3d52'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Delete snapshot completed successfully. Aug 17 16:27:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-88048b67-60f6-49a2-a20f-efa746b209af tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-a20ab8db-f290-4a59-8a64-1ade46f5aa80-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-d6293727-7085-43da-b99f-771c742d159f-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-d6293727-7085-43da-b99f-771c742d159f-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" acquired by "delete_volume" :: waited 0.063s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbaa30-b720-429b-945a-9f5bfcb8fdeb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:44 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:44 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:44 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 1.252s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:44 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f Aug 17 16:27:44 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:45 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6293727-7085-43da-b99f-771c742d159f" returned: 0 in 0.540s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-d6293727-7085-43da-b99f-771c742d159f" released by "delete_volume" :: held 1.977s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['f6ec7e4e-8a55-49fd-aba8-c7643c0c6146', '77a3997a-7370-4592-a00e-b3379bb8884f', 'dffafe7d-447b-4dea-90fe-bdd5dde11b8e', 'b7065dd2-fea5-405a-a0e3-95fd121e128b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:45 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:45 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:46 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9" returned: 0 in 4.682s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f, size 1024.00 MB, duration 4.68 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:27:46 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Converted 1024.00 MB image at 218.64 MB/s Aug 17 16:27:46 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 is being set with open permissions: ugo+rw Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:46 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 Aug 17 16:27:46 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:46 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.573s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Deleted volume successfully. Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6cdfd36-26b4-4481-abfb-15b7b08736e1 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-d6293727-7085-43da-b99f-771c742d159f-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:46 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" released by "_copy_volume_from_snapshot" :: held 5.795s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-96984f61-4948-428a-8421-cf2e7e7070aa" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-96984f61-4948-428a-8421-cf2e7e7070aa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Deleting offline snapshot 96984f61-4948-428a-8421-cf2e7e7070aa of volume 7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] snapshot_file for this snap is: volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[877362e8-770a-4a61-a652-7a8ec7605e95]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:46 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:46 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:46 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:46 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaf30a0-0c66-43ae-bb53-9ee3e7a47a3a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:47 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.443s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9baac6-4f79-4f10-b86c-49ddb439894f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c7ab6-ba2b-4909-95ad-7a58ccc88b18]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:47 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:47 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 Aug 17 16:27:47 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.356s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:27:47 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:47 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:47 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:47 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3 Aug 17 16:27:47 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:47 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" returned: 0 in 0.298s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-quobyte-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3" released by "delete_volume" :: held 0.866s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:47 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.672s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:47 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:47 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Created reservations ['6f680fb5-9461-4053-88a8-7b9051946fc4', '6ce1beea-f464-4e92-93aa-d61b48947a52', '982fac25-5ff3-46d8-bfc4-a24bc3c36d69', 'e7c55c96-1d6a-423e-9e8c-45760128006b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:47 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:47 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:48 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:48 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa Aug 17 16:27:48 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:48 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Deleted volume successfully. Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c99ee236-1473-426d-aa33-da174ce17085 tempest-VolumesSnapshotTestJSON-855968631 None] Lock "cinder-6a72bbd2-4204-47c8-a6b9-67ec38ed08d3-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:48 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f.96984f61-4948-428a-8421-cf2e7e7070aa" returned: 0 in 0.294s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-96984f61-4948-428a-8421-cf2e7e7070aa" released by "_delete_snapshot" :: held 1.943s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.226s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.789s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,created_at=2026-08-17T14:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2078486006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=24f11db4-8a4a-4166-9e9f-5bc5acff612d,host='devstack@QuobyteHD#QuobyteHD',id=9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8301da6451d949a9b95d99e03f526e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:39Z,use_quota=True,user_id='5361f9d41e02422b9904d1bbba354e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee6c4ac8-8936-44cf-a323-2981ba318b8a),volume_type_id=ee6c4ac8-8936-44cf-a323-2981ba318b8a)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Creating volume 9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:48 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad 1073741824 Aug 17 16:27:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2148d6-cb4c-4985-bae3-5972dbdbdad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c77d14-2958-4e83-9549-097617b99de9', 'volume_size': 1, 'source_volid': '7b9baac6-4f79-4f10-b86c-49ddb439894f', 'source_volstatus': 'available'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b65c34-57d4-4ad1-9b4f-c69d9a5f6b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Volume volume-b1c77d14-2958-4e83-9549-097617b99de9 (b1c77d14-2958-4e83-9549-097617b99de9): created successfully Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b65c34-57d4-4ad1-9b4f-c69d9a5f6b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (b01af026-b23b-4871-b6e7-7275b78839cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-435dd549-007a-44ed-88ef-432fb081fa0e tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:27:49 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad 1073741824" returned: 0 in 0.486s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:49 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad Aug 17 16:27:49 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:49 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc3364-6a6d-4fed-901a-e3bf13fb8716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57948546-8cb5-48ee-a74c-6c9540b2305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Volume volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad (9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad): created successfully Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57948546-8cb5-48ee-a74c-6c9540b2305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Flow 'volume_create_manager' (93eb8d95-a41a-4a77-bcf9-d18feca72180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bbc3e512-bd95-4e9a-a81f-bfccfe68fad5 tempest-GroupsTest-1357846312 None] Created volume successfully. Aug 17 16:27:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8984a6d7-dbee-436a-a80f-c0ed4af98a7a tempest-GroupsTest-1357846312 None] Update group completed successfully. Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (911c7914-b5d1-489f-8188-47e29d52f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b4256f-3e30-44a6-88b0-03f7032d3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b4256f-3e30-44a6-88b0-03f7032d3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-288293531',display_name='tempest-VolumesGetTest-Volume-311980382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ba018d-2e26-44ef-8dd5-c422243c8c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:50Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e901b33-51b9-4eae-8d83-fdb1d29f9531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e901b33-51b9-4eae-8d83-fdb1d29f9531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d703a097-a846-4dd4-b970-2d17666d864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d703a097-a846-4dd4-b970-2d17666d864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ba018d-2e26-44ef-8dd5-c422243c8c81', 'volume_name': 'volume-74ba018d-2e26-44ef-8dd5-c422243c8c81', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d7ae77-68b1-453e-8757-59900693b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d7ae77-68b1-453e-8757-59900693b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6f7f5-db9d-4514-af40-8538f0d2ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:50 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Volume 74ba018d-2e26-44ef-8dd5-c422243c8c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ba018d-2e26-44ef-8dd5-c422243c8c81', 'volume_size': 1} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:27:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-288293531',display_name='tempest-VolumesGetTest-Volume-311980382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ba018d-2e26-44ef-8dd5-c422243c8c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:27:50Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Creating volume 74ba018d-2e26-44ef-8dd5-c422243c8c81 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:27:50 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:27:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:50 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 1073741824 Aug 17 16:27:50 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:51 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 1073741824" returned: 0 in 0.476s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:51 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 Aug 17 16:27:51 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:51 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81" returned: 0 in 0.374s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d6f7f5-db9d-4514-af40-8538f0d2ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ba018d-2e26-44ef-8dd5-c422243c8c81', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce237f2-87db-41be-bc36-4fcdab03b557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:27:51 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Volume volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 (74ba018d-2e26-44ef-8dd5-c422243c8c81): created successfully Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce237f2-87db-41be-bc36-4fcdab03b557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:27:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (911c7914-b5d1-489f-8188-47e29d52f371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:27:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6a07d01-636e-4423-a9d6-91f886470b23 tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:27:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-25c594a3-ec5b-4864-947d-e79aa0099c91 tempest-GroupsTest-1357846312 None] Update group completed successfully. Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-74ba018d-2e26-44ef-8dd5-c422243c8c81-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "cinder-74ba018d-2e26-44ef-8dd5-c422243c8c81-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-74ba018d-2e26-44ef-8dd5-c422243c8c81" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-74ba018d-2e26-44ef-8dd5-c422243c8c81" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[894ff73e-d626-447b-b7f7-f6fb5e970bcb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:52 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 Aug 17 16:27:52 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:53 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81" returned: 0 in 0.437s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:53 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81 Aug 17 16:27:53 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Acquiring lock "cinder-quobyte-09768cef-021c-4f86-94b2-277e257d7312" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-09768cef-021c-4f86-94b2-277e257d7312" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f97a75-8f1d-4f26-b7ed-e49c9d354f71]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:53 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74ba018d-2e26-44ef-8dd5-c422243c8c81" returned: 0 in 0.465s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-74ba018d-2e26-44ef-8dd5-c422243c8c81" released by "delete_volume" :: held 0.960s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:53 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 Aug 17 16:27:53 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Created reservations ['d517e5a8-9e21-4fd4-acf9-eb6a4e208137', '34ef3475-86d0-4724-bd08-22307034760c', '93f130b6-b9e6-4122-baf6-250c05ba2b11', '9969ffbb-bd2e-4033-92ba-3903a5ee7ec3'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:53 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:53 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:54 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312" returned: 0 in 0.579s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:54 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312 Aug 17 16:27:54 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:54 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bf103e0f-9133-4110-b438-bc23d2211e57 tempest-VolumesGetTest-1899419658 None] Lock "cinder-74ba018d-2e26-44ef-8dd5-c422243c8c81-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:54 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-09768cef-021c-4f86-94b2-277e257d7312" returned: 0 in 0.319s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-09768cef-021c-4f86-94b2-277e257d7312" released by "delete_volume" :: held 0.951s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Acquiring lock "cinder-quobyte-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fbb49b-3d7a-4033-96d5-10efa41437aa]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:54 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad Aug 17 16:27:54 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:55 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" returned: 0 in 0.541s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:55 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad Aug 17 16:27:55 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-b1c77d14-2958-4e83-9549-097617b99de9-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "cinder-b1c77d14-2958-4e83-9549-097617b99de9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:55 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "cinder-quobyte-9026d0e7-e1c9-46e8-b65d-ecf37cdfcbad" released by "delete_volume" :: held 0.970s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[122cd0ca-6c68-40b5-8904-7e85107a7511]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Created reservations ['ee7766bb-93ae-4ce6-8438-fd5bba184f73'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-f8cbbc2d-bc48-4545-adf2-894034178ce3 req-35f96484-e07b-4586-b0dd-e6cd9e701636 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-f8cbbc2d-bc48-4545-adf2-894034178ce3 req-35f96484-e07b-4586-b0dd-e6cd9e701636 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-f8cbbc2d-bc48-4545-adf2-894034178ce3 req-35f96484-e07b-4586-b0dd-e6cd9e701636 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:55 devstack cinder-volume[94468]: WARNING cinder.quota [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-642660104 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-642660104, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:27:55 devstack cinder-volume[94468]: WARNING cinder.quota [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-642660104 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-642660104, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Created reservations ['92050311-be16-4d1e-899b-fccf14aa3f01', '6f490fa6-05f6-4402-8521-b46ea3fa4cd3', '6678e916-6e51-48ae-92fa-6b9b97cd0cae', '8a0916f8-2d0a-45ab-b6e1-e8f4261976f0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:55 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 Aug 17 16:27:55 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-f8cbbc2d-bc48-4545-adf2-894034178ce3 req-35f96484-e07b-4586-b0dd-e6cd9e701636 tempest-TestServerVolumeAttachmentScenario-593162091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10c65127-4598-410d-89e5-504e7def5188', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:27:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-f8cbbc2d-bc48-4545-adf2-894034178ce3 req-35f96484-e07b-4586-b0dd-e6cd9e701636 tempest-TestServerVolumeAttachmentScenario-593162091 None] attachment_update completed successfully. Aug 17 16:27:55 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Created reservations ['082c6d8d-f354-45bb-9807-b2b60d903f82', 'd472f76e-db5e-434b-9f9c-5efa7e0905a3', 'c7a8e952-cb0b-4fe1-bcf7-d83ae0b4d35c', 'b8b15d78-d172-45f4-b8be-cc4a8f3a2ae7'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:56 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9" returned: 0 in 0.576s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:56 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:56 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:56 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9 Aug 17 16:27:56 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:56 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.402s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-615d0b5a-3bed-44e8-bc9f-1d325724f28e tempest-GroupsTest-1357846312 None] Delete group completed successfully. Aug 17 16:27:56 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b1c77d14-2958-4e83-9549-097617b99de9" returned: 0 in 0.527s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-b1c77d14-2958-4e83-9549-097617b99de9" released by "delete_volume" :: held 1.178s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Created reservations ['d3fa8eb4-094e-463d-8f24-353e9bfc5308', '5b38dcb1-a0cb-4360-be85-01326d5aa8ee', 'b8ba2d0e-bd20-4851-8d52-177ff68a3477', '474b9e4c-c1a7-49bd-9c7d-d2bcefc534f3'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:56 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:56 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:57 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.330s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-dc6b4873-489c-4c76-b0e1-e7382ce71865 tempest-VolumesGetTest-1899419658 None] Lock "cinder-b1c77d14-2958-4e83-9549-097617b99de9-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-7b9baac6-4f79-4f10-b86c-49ddb439894f-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "cinder-7b9baac6-4f79-4f10-b86c-49ddb439894f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-7b9baac6-4f79-4f10-b86c-49ddb439894f" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-7b9baac6-4f79-4f10-b86c-49ddb439894f" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfe2352-3bd0-496c-b70b-33f90b977c12]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:27:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:58 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:58 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:58 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.551s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:58 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f Aug 17 16:27:58 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:58 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7b9baac6-4f79-4f10-b86c-49ddb439894f" returned: 0 in 0.331s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-7b9baac6-4f79-4f10-b86c-49ddb439894f" released by "delete_volume" :: held 0.971s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:27:58 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Created reservations ['fb674d6e-d212-4da5-ab0c-93b895ff9e1d', 'c8954cf3-9eb0-4f03-9320-447a801249e1', 'd195015b-72df-4a2d-99f6-c124be2412ac', '23321709-ec62-45a8-aa0b-e2c24467e49e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:27:59 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:27:59 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:27:59 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.413s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:27:59 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:27:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd3ea385-147e-4fcb-8e1f-b48996122baa tempest-VolumesGetTest-1899419658 None] Lock "cinder-7b9baac6-4f79-4f10-b86c-49ddb439894f-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (0d4b6543-f159-472e-b916-407c17c5a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ac1fd4-70be-4414-bb3b-413357942f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ac1fd4-70be-4414-bb3b-413357942f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1429635120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b48593-38a9-4299-8ce4-adaf3b6bca40,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:00Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a24825-9dd1-49b5-ab57-4b16d27b92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a24825-9dd1-49b5-ab57-4b16d27b92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1e4530-b02c-4615-b03b-336d03dfa7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1e4530-b02c-4615-b03b-336d03dfa7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9b48593-38a9-4299-8ce4-adaf3b6bca40', 'volume_name': 'volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b185cc41-8e14-4269-8a91-7772613196f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b185cc41-8e14-4269-8a91-7772613196f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c118ff-09e8-4722-86d4-4a21b0f7e8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Volume c9b48593-38a9-4299-8ce4-adaf3b6bca40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 16:28:00 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Trying to clone c9b48593-38a9-4299-8ce4-adaf3b6bca40 from image 9d40602e-5637-4537-aeab-5c295ac7c705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:28:01 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:28:01 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Image download 20.69 MB at 20.69 MB/s Aug 17 16:28:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d5f97-b25a-4b98-9e0f-0f3d7b5f02c0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:01 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD Aug 17 16:28:01 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:02 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 is fetched for user aab42654e155466fbea4904704a6748f. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[042cf72f-c439-469e-acbe-ca2b6f90cc7c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:02 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD Aug 17 16:28:02 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:02 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1429635120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b48593-38a9-4299-8ce4-adaf3b6bca40,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:00Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Creating volume c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:28:02 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:28:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:02 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1073741824 Aug 17 16:28:02 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a3a4da66-51b2-4943-a8ea-ff7b5cfaef19 req-d071ed2a-64f3-4a02-b2c4-bb8e47835f8f tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:03 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1073741824" returned: 0 in 0.662s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:03 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 Aug 17 16:28:03 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:03 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a3a4da66-51b2-4943-a8ea-ff7b5cfaef19 req-d071ed2a-64f3-4a02-b2c4-bb8e47835f8f tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.661s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a3a4da66-51b2-4943-a8ea-ff7b5cfaef19 req-d071ed2a-64f3-4a02-b2c4-bb8e47835f8f tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Attempting download of 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume c9b48593-38a9-4299-8ce4-adaf3b6bca40. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a3a4da66-51b2-4943-a8ea-ff7b5cfaef19 req-d071ed2a-64f3-4a02-b2c4-bb8e47835f8f tempest-TestServerVolumeAttachmentScenario-593162091 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-8913bf97-28d2-4c23-bf60-2e5a882b9322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8fc10d1-b29d-4596-86a7-b0f5f950561a', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1aee52-34cc-4e57-a150-c34e5e2eca08]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a3a4da66-51b2-4943-a8ea-ff7b5cfaef19 req-d071ed2a-64f3-4a02-b2c4-bb8e47835f8f tempest-TestServerVolumeAttachmentScenario-593162091 None] attachment_update completed successfully. Aug 17 16:28:04 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj Aug 17 16:28:04 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c3d877c-ddb0-473c-a6ba-4e9f06558d84 tempest-GroupsV320Test-959027063 None] Group tempest-GroupsV320Test-Group-326942137: creating Aug 17 16:28:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c3d877c-ddb0-473c-a6ba-4e9f06558d84 tempest-GroupsV320Test-959027063 None] Group tempest-GroupsV320Test-Group-326942137: created successfully Aug 17 16:28:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c3d877c-ddb0-473c-a6ba-4e9f06558d84 tempest-GroupsV320Test-959027063 None] Create group completed successfully. Aug 17 16:28:04 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj" returned: 0 in 0.509s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:04 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj Aug 17 16:28:04 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:04 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj" returned: 1 in 0.457s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_u6jr3tyj' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe29a5f-59ee-4c96-a56a-034a84d1e793]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:05 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD Aug 17 16:28:05 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:05 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:05 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] 9d40602e-5637-4537-aeab-5c295ac7c705 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:28:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:05 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 Aug 17 16:28:05 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Created reservations ['07d8297e-168e-42b2-ab44-0433c684e17c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:06 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:06 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:06 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.347s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-05dcc7a4-e4d4-4116-aa34-f540a2c122f3 tempest-GroupsV320Test-959027063 None] Delete group completed successfully. Aug 17 16:28:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-2b5768b2-cac7-492c-9ba0-577560504225 req-31e029aa-3782-44f7-bafe-81eda2a2f3cb tempest-TestServerVolumeAttachmentScenario-593162091 None] Terminate volume connection completed successfully. Aug 17 16:28:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-2b5768b2-cac7-492c-9ba0-577560504225 req-31e029aa-3782-44f7-bafe-81eda2a2f3cb tempest-TestServerVolumeAttachmentScenario-593162091 None] Deleting attachment e8fc10d1-b29d-4596-86a7-b0f5f950561a. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:28:08 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40" returned: 0 in 2.797s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_rq6fuwzcdevstack@QuobyteHD, size 112.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:28:08 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Converted 112.00 MB image at 40.03 MB/s Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:08 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1G Aug 17 16:28:08 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:08 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 1G" returned: 0 in 0.434s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Downloaded image 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume c9b48593-38a9-4299-8ce4-adaf3b6bca40 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 for user aab42654e155466fbea4904704a6748f is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Marking volume c9b48593-38a9-4299-8ce4-adaf3b6bca40 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Copying metadata from image 9d40602e-5637-4537-aeab-5c295ac7c705 to c9b48593-38a9-4299-8ce4-adaf3b6bca40. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Creating volume glance metadata for volume c9b48593-38a9-4299-8ce4-adaf3b6bca40 backed by image 9d40602e-5637-4537-aeab-5c295ac7c705 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c118ff-09e8-4722-86d4-4a21b0f7e8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ca9da3-73b5-4f9c-a1a0-05c9cda91f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Volume volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 (c9b48593-38a9-4299-8ce4-adaf3b6bca40): created successfully Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ca9da3-73b5-4f9c-a1a0-05c9cda91f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (0d4b6543-f159-472e-b916-407c17c5a308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6b82901-388d-446a-b1f6-c9fee57e2bc2 tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:28:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-1609c763-562d-4545-a7d5-f5cd9d0b6097 req-ec0e5368-1c3c-44d4-ad4a-9f22d4831a94 tempest-TestServerVolumeAttachmentScenario-593162091 None] Terminate volume connection completed successfully. Aug 17 16:28:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-1609c763-562d-4545-a7d5-f5cd9d0b6097 req-ec0e5368-1c3c-44d4-ad4a-9f22d4831a94 tempest-TestServerVolumeAttachmentScenario-593162091 None] Deleting attachment 10c65127-4598-410d-89e5-504e7def5188. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (5d9efb24-0e43-4cb8-ad67-d8011f8b4cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892a01b2-c384-4ed5-aaef-4c021a4955bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892a01b2-c384-4ed5-aaef-4c021a4955bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-633871859',display_name='tempest-VolumesGetTest-Volume-569470731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ec36f-9088-4f32-8273-0c13233fb980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:10Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ac9cc-a2be-4010-baa3-56a0a1835f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189ac9cc-a2be-4010-baa3-56a0a1835f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e12613a-043e-43bc-803f-38831c1267ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e12613a-043e-43bc-803f-38831c1267ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5ec36f-9088-4f32-8273-0c13233fb980', 'volume_name': 'volume-bc5ec36f-9088-4f32-8273-0c13233fb980', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd76101-5178-48c8-80d1-feb1858bc2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd76101-5178-48c8-80d1-feb1858bc2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae362bbc-ffc6-4e9d-8eeb-564f6feb51ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:10 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Volume bc5ec36f-9088-4f32-8273-0c13233fb980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5ec36f-9088-4f32-8273-0c13233fb980', 'volume_size': 1} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-633871859',display_name='tempest-VolumesGetTest-Volume-569470731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ec36f-9088-4f32-8273-0c13233fb980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2e436b7f234b4bb93d7618a63509d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:10Z,use_quota=True,user_id='aab42654e155466fbea4904704a6748f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Creating volume bc5ec36f-9088-4f32-8273-0c13233fb980 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:28:10 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:28:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:10 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 1073741824 Aug 17 16:28:10 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:11 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 1073741824" returned: 0 in 0.937s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:11 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 Aug 17 16:28:11 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:11 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.377s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae362bbc-ffc6-4e9d-8eeb-564f6feb51ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5ec36f-9088-4f32-8273-0c13233fb980', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1d323e-9797-44fd-9af2-e7cc81b268ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:11 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Volume volume-bc5ec36f-9088-4f32-8273-0c13233fb980 (bc5ec36f-9088-4f32-8273-0c13233fb980): created successfully Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1d323e-9797-44fd-9af2-e7cc81b268ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Flow 'volume_create_manager' (5d9efb24-0e43-4cb8-ad67-d8011f8b4cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ed0f399a-ad6d-4f70-a96a-a771f1526d01 tempest-VolumesGetTest-1899419658 None] Created volume successfully. Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-bc5ec36f-9088-4f32-8273-0c13233fb980-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "cinder-bc5ec36f-9088-4f32-8273-0c13233fb980-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-bc5ec36f-9088-4f32-8273-0c13233fb980" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-bc5ec36f-9088-4f32-8273-0c13233fb980" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f0dfd-7720-4bd6-b498-6f5d8cf6e2db]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:12 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 Aug 17 16:28:12 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:13 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:13 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980 Aug 17 16:28:13 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:13 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc5ec36f-9088-4f32-8273-0c13233fb980" returned: 0 in 0.348s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-bc5ec36f-9088-4f32-8273-0c13233fb980" released by "delete_volume" :: held 0.888s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Created reservations ['c0f23f81-8282-43d4-a8ef-44fd6b571a91', '3af57a97-b4ea-4b2f-ab9f-ed5e83654070', 'ecdefdf8-d244-4e14-a371-c251e8f32e7b', '4fe09815-ea70-4beb-bda8-68157cb1958e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:13 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:13 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-c9b48593-38a9-4299-8ce4-adaf3b6bca40-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "cinder-c9b48593-38a9-4299-8ce4-adaf3b6bca40-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Acquiring lock "cinder-quobyte-c9b48593-38a9-4299-8ce4-adaf3b6bca40" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-c9b48593-38a9-4299-8ce4-adaf3b6bca40" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df4239-f756-4744-ba4c-2567a69871dd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:14 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.343s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c313ca24-dbfa-4db9-8940-52055d575242 tempest-VolumesGetTest-1899419658 None] Lock "cinder-bc5ec36f-9088-4f32-8273-0c13233fb980-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:14 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 Aug 17 16:28:14 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:14 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40" returned: 0 in 0.507s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:14 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40 Aug 17 16:28:14 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:14 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c9b48593-38a9-4299-8ce4-adaf3b6bca40" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "cinder-quobyte-c9b48593-38a9-4299-8ce4-adaf3b6bca40" released by "delete_volume" :: held 0.864s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Created reservations ['9a3f0b23-dc79-47e3-8cb1-d9bcee672975', '9b8192c9-db23-484f-9306-c70b4182a3a3', 'b96d8e4d-86bd-4285-9db5-1584eed1e5a6', '8d207d6f-3714-4533-ab52-6028e64fa82f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:15 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:15 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:15 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.511s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Deleted volume successfully. Aug 17 16:28:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4033dc9d-9703-4705-b523-7e5e2b88d970 tempest-VolumesGetTest-1899419658 None] Lock "cinder-c9b48593-38a9-4299-8ce4-adaf3b6bca40-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "cinder-8913bf97-28d2-4c23-bf60-2e5a882b9322-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-8913bf97-28d2-4c23-bf60-2e5a882b9322-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "cinder-quobyte-8913bf97-28d2-4c23-bf60-2e5a882b9322" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-quobyte-8913bf97-28d2-4c23-bf60-2e5a882b9322" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c4e37-752c-4f22-a94b-409dc5543ac7]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:18 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 Aug 17 16:28:18 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:19 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322" returned: 0 in 0.534s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:19 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322 Aug 17 16:28:19 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:19 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-8913bf97-28d2-4c23-bf60-2e5a882b9322" returned: 0 in 0.299s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-quobyte-8913bf97-28d2-4c23-bf60-2e5a882b9322" released by "delete_volume" :: held 0.890s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Created reservations ['0512d5fa-d281-4373-9a01-92578584c77c', '05fb8a5c-a54a-4258-9ef0-907c08e58657', '352c40b1-d8b5-47bb-8030-83efd5ffcf6a', '8312aeab-df05-439d-b1e2-affab9a1c678'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:19 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:19 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "cinder-1c5b2b9f-236c-4828-b402-8d85ac99baa6-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-1c5b2b9f-236c-4828-b402-8d85ac99baa6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "cinder-quobyte-1c5b2b9f-236c-4828-b402-8d85ac99baa6" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-quobyte-1c5b2b9f-236c-4828-b402-8d85ac99baa6" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb389d-c94b-4186-917f-ccccd46dea3d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:20 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 Aug 17 16:28:20 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:20 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.482s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Deleted volume successfully. Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f9c2592a-5da2-4d39-ad90-40070fca0571 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-8913bf97-28d2-4c23-bf60-2e5a882b9322-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:20 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6" returned: 0 in 0.507s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:20 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6 Aug 17 16:28:20 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:20 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1c5b2b9f-236c-4828-b402-8d85ac99baa6" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-quobyte-1c5b2b9f-236c-4828-b402-8d85ac99baa6" released by "delete_volume" :: held 0.932s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:20 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Created reservations ['c37c5ee3-7a9c-4bc2-a5db-ed694ed5add5', '582a78c4-76c8-4d03-b27f-7d545414b18c', 'eee50975-95df-4f77-9620-ef701fbc5175', 'a297bd69-20aa-420e-bc84-c6bde35b7a21'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:21 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:21 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:21 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.378s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Deleted volume successfully. Aug 17 16:28:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f6a434d3-d4da-4cf9-8079-de3cd4601c16 tempest-TestServerVolumeAttachmentScenario-593162091 None] Lock "cinder-1c5b2b9f-236c-4828-b402-8d85ac99baa6-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:31 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=153,cinder:SELECT=143,cinder:DELETE=7,cinder:INSERT=46 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:28:31 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=128,cinder:UPDATE=150,cinder:INSERT=36,cinder:DELETE=13 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Flow 'volume_create_manager' (0a4e13ea-8ebd-4fe6-abfb-91110d3f2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b73c65-b553-4f5e-8fe9-54d6043a017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b73c65-b553-4f5e-8fe9-54d6043a017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1144712443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17396fe2-37f2-4abb-a087-3fa0a42ac5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619e72694da46a7aa041159369a94ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:36Z,use_quota=True,user_id='43f98fc665754a88a7f8785fafb7a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9072cbd-5b90-4350-8889-a276915d0cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9072cbd-5b90-4350-8889-a276915d0cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f716852b-4802-4b5b-ad93-358f1a160416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f716852b-4802-4b5b-ad93-358f1a160416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17396fe2-37f2-4abb-a087-3fa0a42ac5af', 'volume_name': 'volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80788a92-d52e-43f7-a2c3-93b0b8055a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80788a92-d52e-43f7-a2c3-93b0b8055a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6184808-247e-413e-9e8b-537ca642ce4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:36 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af', 'volume_size': 1} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1144712443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17396fe2-37f2-4abb-a087-3fa0a42ac5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f619e72694da46a7aa041159369a94ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:28:36Z,use_quota=True,user_id='43f98fc665754a88a7f8785fafb7a827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Creating volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:28:36 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:36 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af 1073741824 Aug 17 16:28:36 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:36 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af 1073741824" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:36 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af Aug 17 16:28:36 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:37 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6184808-247e-413e-9e8b-537ca642ce4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e9668-c14d-4653-a2ba-7010df893945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:28:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Volume volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af (17396fe2-37f2-4abb-a087-3fa0a42ac5af): created successfully Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e9668-c14d-4653-a2ba-7010df893945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:28:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Flow 'volume_create_manager' (0a4e13ea-8ebd-4fe6-abfb-91110d3f2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:28:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ae7ddd0c-1650-4eb5-bf99-0f3ede2febf4 tempest-SnapshotsActionsTest-1479889253 None] Created volume successfully. Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Creating offline snapshot 80e2858e-61fa-4738-9611-55d9cfae54e6 of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cd0b2f-02d0-4e4b-84b9-f77fe78cfaa2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:38 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af Aug 17 16:28:38 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:38 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af" returned: 0 in 0.380s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:38 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 1G Aug 17 16:28:38 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:39 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 1G" returned: 0 in 0.536s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:39 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:39 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:39 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:39 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 is being set with open permissions: ugo+rw Aug 17 16:28:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:39 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:39 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:40 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.328s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:40 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info Aug 17 16:28:40 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:40 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:40 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info is being set with open permissions: ugo+rw Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:40 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info Aug 17 16:28:40 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:40 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.info" returned: 0 in 0.317s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6bc950c4-9473-4910-9295-56686232c07c tempest-SnapshotsActionsTest-1479889253 None] Create snapshot completed successfully Aug 17 16:28:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Creating offline snapshot 653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:28:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea741b92-a812-400d-bcf2-686fccd9e5ff]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:43 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:43 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:43 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.782s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:43 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae 1G Aug 17 16:28:43 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:44 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae 1G" returned: 0 in 0.813s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:44 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae Aug 17 16:28:44 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:45 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" returned: 0 in 0.443s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae is being set with open permissions: ugo+rw Aug 17 16:28:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:45 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae Aug 17 16:28:45 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:45 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" returned: 0 in 0.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0baa11fa-c507-42d4-a185-eee30618deb6 tempest-SnapshotsActionsTest-1479889253 None] Create snapshot completed successfully Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Deleting offline snapshot 653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] snapshot_file for this snap is: volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc459f30-0b9b-49da-ac99-1acc8b942146]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:46 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae Aug 17 16:28:46 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:46 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:28:46 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:47 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.373s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:28:47 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" returned: 0 in 0.661s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[73df2ac5-b0cb-483b-bc9c-9b759453cca8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:47 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:47 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:47 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.596s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:47 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae Aug 17 16:28:47 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:48 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" returned: 0 in 0.588s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:48 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae Aug 17 16:28:48 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:48 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae" released by "_delete_snapshot" :: held 2.363s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_snapshot" :: held 2.420s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:48 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Created reservations ['45fd0f9d-128a-496a-afde-0ce156007140', '20a958fb-7441-4edb-a3d1-0c625423b1ce', '5b982743-5121-4e6f-983a-2c0c7555a32b', '0718425c-7062-49d8-ae99-4cb2f6ed8101'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Delete snapshot completed successfully. Aug 17 16:28:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8e1f5e6e-f040-4bde-bccd-c6a1ff4e3429 tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-653e0fad-d0a9-4e1d-8b6c-b0e15a6678ae-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Creating offline snapshot 9970380c-6feb-4bd5-ac39-f40d6e1b6e2b of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1fcff-e916-4686-a31f-6f7d3ab2f7ca]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:50 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:50 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:50 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.657s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:51 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b 1G Aug 17 16:28:51 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:51 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b 1G" returned: 0 in 0.775s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:51 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b Aug 17 16:28:51 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:52 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" returned: 0 in 0.679s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:52 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b is being set with open permissions: ugo+rw Aug 17 16:28:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:52 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b Aug 17 16:28:52 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:53 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" returned: 0 in 0.632s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:28:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f6fc8959-979a-403f-a4b5-945a5fd00658 tempest-SnapshotsActionsTest-1479889253 None] Create snapshot completed successfully Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Deleting offline snapshot 9970380c-6feb-4bd5-ac39-f40d6e1b6e2b of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] snapshot_file for this snap is: volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca35c3d-a520-4d9c-8850-32a9c50dd425]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:53 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b Aug 17 16:28:53 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:54 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" returned: 0 in 0.644s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d483019c-60fc-41f5-85b3-199278280f77]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:54 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:54 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:55 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.615s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:55 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b Aug 17 16:28:55 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:56 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" returned: 0 in 0.900s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:56 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b Aug 17 16:28:56 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:56 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b" released by "_delete_snapshot" :: held 2.776s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_snapshot" :: held 2.827s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Created reservations ['59f9440c-1524-4d64-9d14-aab67f9a8539', '16a00c1d-f18c-4e87-87b0-d8bd0c0079ae', 'b650d423-7d4b-4479-b13e-29929d084471', '04070953-5fda-486e-aef9-7f2be133143a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:28:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Delete snapshot completed successfully. Aug 17 16:28:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2b2e7aa4-97aa-46aa-acf9-39d66bb0525f tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-9970380c-6feb-4bd5-ac39-f40d6e1b6e2b-delete_snapshot" released by "delete_snapshot" :: held 3.112s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:28:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:28:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:28:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Creating offline snapshot e5b9749b-58ad-4a87-b345-014a8dbde0cd of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:28:58 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[692b3f01-f274-463f-bc6f-05265fd0abc3]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:28:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:58 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:28:58 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:59 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 1.037s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:28:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:59 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd 1G Aug 17 16:28:59 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:28:59 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Aug 17 16:28:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd 1G" returned: 0 in 0.795s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:28:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:28:59 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd Aug 17 16:28:59 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:00 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd" returned: 0 in 0.573s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:00 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd is being set with open permissions: ugo+rw Aug 17 16:29:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:00 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd Aug 17 16:29:00 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:01 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd" returned: 0 in 0.568s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b98b5626-8d1b-4aff-9b4f-e0dc0d79102e tempest-SnapshotsActionsTest-1479889253 None] Create snapshot completed successfully Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-e5b9749b-58ad-4a87-b345-014a8dbde0cd-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-e5b9749b-58ad-4a87-b345-014a8dbde0cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-e5b9749b-58ad-4a87-b345-014a8dbde0cd" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-e5b9749b-58ad-4a87-b345-014a8dbde0cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Deleting offline snapshot e5b9749b-58ad-4a87-b345-014a8dbde0cd of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] snapshot_file for this snap is: volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a13d1d-d8ca-4d99-863b-841760ff91c0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:02 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd Aug 17 16:29:02 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:03 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd" returned: 0 in 0.667s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[956b730f-d711-4464-9778-a9e595ef6542]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:03 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:03 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:04 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.710s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:04 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd Aug 17 16:29:04 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:05 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd" returned: 0 in 1.012s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:05 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd Aug 17 16:29:05 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:05 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.e5b9749b-58ad-4a87-b345-014a8dbde0cd" returned: 0 in 0.717s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-e5b9749b-58ad-4a87-b345-014a8dbde0cd" released by "_delete_snapshot" :: held 3.277s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_snapshot" :: held 3.310s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:06 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Created reservations ['e3d6bb43-a47d-4609-a068-4e75c09d22f2', 'e812641c-19dd-4aac-8499-e8f10c115d48', '1b38c799-7db8-44ca-9d2b-35e7eb1965b8', '346e682c-76aa-4453-bc07-cca6880e0ed0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:29:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Delete snapshot completed successfully. Aug 17 16:29:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-48c6b3a2-19b0-4456-8756-885da917985c tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-e5b9749b-58ad-4a87-b345-014a8dbde0cd-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Creating offline snapshot 0113a934-60db-4708-a5b5-e0883a4a174f of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:29:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[895cf228-d695-4c16-a9e7-0348c13e01cc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:08 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:08 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:08 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.596s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:08 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f 1G Aug 17 16:29:08 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:09 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f 1G" returned: 0 in 1.117s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:09 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f Aug 17 16:29:09 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:10 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f" returned: 0 in 0.495s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:10 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f is being set with open permissions: ugo+rw Aug 17 16:29:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:10 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f Aug 17 16:29:10 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:10 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f" returned: 0 in 0.432s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.820s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d3e28a1c-411e-4eef-9c92-008fe257ee24 tempest-SnapshotsActionsTest-1479889253 None] Create snapshot completed successfully Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-0113a934-60db-4708-a5b5-e0883a4a174f-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-0113a934-60db-4708-a5b5-e0883a4a174f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Acquiring lock "cinder-quobyte-0113a934-60db-4708-a5b5-e0883a4a174f" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-0113a934-60db-4708-a5b5-e0883a4a174f" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Deleting offline snapshot 0113a934-60db-4708-a5b5-e0883a4a174f of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] snapshot_file for this snap is: volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11da450-c84d-442d-a957-32ffe5bd2ad9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:11 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f Aug 17 16:29:11 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:11 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f" returned: 0 in 0.590s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecfe4dc-56b9-4245-87ab-b36e27ae1a19]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:12 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:12 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Flow 'volume_create_manager' (a7204791-ea2f-4a0c-9ffd-c20188a114cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb2f0c5-3883-45e4-af9e-dd6e79c66db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb2f0c5-3883-45e4-af9e-dd6e79c66db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-756742079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122c8949a937402394485934e1691759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:12Z,use_quota=True,user_id='e0960248f641428c92c29c9bef52071e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:12 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfec41c1-2fab-4ea7-b2a8-0193ba3c9e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfec41c1-2fab-4ea7-b2a8-0193ba3c9e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb853d45-4981-4207-b2e9-390352595c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb853d45-4981-4207-b2e9-390352595c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1', 'volume_name': 'volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b4512c-4228-4678-9c79-736a6b93c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b4512c-4228-4678-9c79-736a6b93c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2546b4-3bb4-44d8-8691-694b4120acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:12 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Volume 5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1', 'volume_size': 1} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-756742079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122c8949a937402394485934e1691759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:12Z,use_quota=True,user_id='e0960248f641428c92c29c9bef52071e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Creating volume 5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:29:12 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.495s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:12 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 1073741824 Aug 17 16:29:12 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:12 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f Aug 17 16:29:12 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:12 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f" returned: 0 in 0.463s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:12 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 1073741824" returned: 0 in 0.500s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:12 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f Aug 17 16:29:12 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:12 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 Aug 17 16:29:13 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:13 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.0113a934-60db-4708-a5b5-e0883a4a174f" returned: 0 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-0113a934-60db-4708-a5b5-e0883a4a174f" released by "_delete_snapshot" :: held 2.099s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_snapshot" :: held 2.162s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:13 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" returned: 0 in 0.374s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2546b4-3bb4-44d8-8691-694b4120acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8f71b4-1614-440c-94b6-90a03947eb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:13 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Volume volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 (5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1): created successfully Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8f71b4-1614-440c-94b6-90a03947eb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Flow 'volume_create_manager' (a7204791-ea2f-4a0c-9ffd-c20188a114cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb735e70-c95a-4900-8fa2-cdecb5cb1f64 tempest-TestMinimumBasicScenario-536596805 None] Created volume successfully. Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Created reservations ['54c3b630-2150-4828-934e-74c0521799e3', 'c327f13e-0f43-4a41-8cb6-de8fd2259dbb', '742fe10a-295b-4ce0-83c4-29c00da2699f', '00b99f35-4d65-49b3-8df9-5f5ccea933b1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:29:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Delete snapshot completed successfully. Aug 17 16:29:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-068be5a2-0b55-401e-b541-829641456d7e tempest-SnapshotsActionsTest-541411812 None] Lock "cinder-0113a934-60db-4708-a5b5-e0883a4a174f-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "cinder-80e2858e-61fa-4738-9611-55d9cfae54e6-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-80e2858e-61fa-4738-9611-55d9cfae54e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "cinder-quobyte-80e2858e-61fa-4738-9611-55d9cfae54e6" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-80e2858e-61fa-4738-9611-55d9cfae54e6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Deleting offline snapshot 80e2858e-61fa-4738-9611-55d9cfae54e6 of volume 17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] snapshot_file for this snap is: volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c256450e-7028-4c46-9d79-f1fb42675229]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:15 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:15 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:15 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.595s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b03b454a-b70a-4440-96e2-d8ccf66e6101 req-a5519a69-4f9a-48be-ad59-b66d3438f63e tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b03b454a-b70a-4440-96e2-d8ccf66e6101 req-a5519a69-4f9a-48be-ad59-b66d3438f63e tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5012b08-f804-4dc0-95f3-648adea6b115]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-b03b454a-b70a-4440-96e2-d8ccf66e6101 req-a5519a69-4f9a-48be-ad59-b66d3438f63e tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-b03b454a-b70a-4440-96e2-d8ccf66e6101 req-a5519a69-4f9a-48be-ad59-b66d3438f63e tempest-TestMinimumBasicScenario-536596805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb011d3b-ff98-4e58-8c18-2f8b1f51cf52', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:29:16 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af Aug 17 16:29:16 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:16 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-b03b454a-b70a-4440-96e2-d8ccf66e6101 req-a5519a69-4f9a-48be-ad59-b66d3438f63e tempest-TestMinimumBasicScenario-536596805 None] attachment_update completed successfully. Aug 17 16:29:17 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af" returned: 0 in 1.304s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:17 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:17 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:17 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.799s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:17 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6 Aug 17 16:29:17 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:18 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af.80e2858e-61fa-4738-9611-55d9cfae54e6" returned: 0 in 0.601s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-80e2858e-61fa-4738-9611-55d9cfae54e6" released by "_delete_snapshot" :: held 3.497s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_snapshot" :: held 3.536s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:18 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Created reservations ['a351f67d-44e1-4544-a07c-f246ecfc1bab', '0133825b-8a97-42cd-a90a-8538960ae413', '9897949a-97ae-406d-80ba-e3c20d7969a7', 'd2e4978e-e7da-4cd7-ba7b-94ac05417a69'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:29:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Delete snapshot completed successfully. Aug 17 16:29:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-116acc2a-0695-4901-9b1d-33a2d67c446a tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-80e2858e-61fa-4738-9611-55d9cfae54e6-delete_snapshot" released by "delete_snapshot" :: held 3.894s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "cinder-17396fe2-37f2-4abb-a087-3fa0a42ac5af-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-17396fe2-37f2-4abb-a087-3fa0a42ac5af-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0aba59-2450-44b0-9e44-b7d6876c6e0a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:20 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af Aug 17 16:29:20 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:20 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af" returned: 0 in 0.726s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:20 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af Aug 17 16:29:20 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:20 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-17396fe2-37f2-4abb-a087-3fa0a42ac5af" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-quobyte-17396fe2-37f2-4abb-a087-3fa0a42ac5af" released by "delete_volume" :: held 1.254s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Created reservations ['2d963869-abab-4dc2-9666-054fa12bd9ad', '90e0e6b1-a962-4374-8fd3-03a914e80fda', '2ea15c9d-a8c4-4d7e-8381-c1ca72299a46', '06d63a77-b2fa-468a-a30f-12448706ea23'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:21 devstack sudo[109301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:29:21 devstack sudo[109301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:21 devstack sudo[109301]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.338s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:29:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Deleted volume successfully. Aug 17 16:29:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ed149e7-8ba4-4fac-bda5-10abac54c34e tempest-SnapshotsActionsTest-1479889253 None] Lock "cinder-17396fe2-37f2-4abb-a087-3fa0a42ac5af-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:29:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Flow 'volume_create_manager' (4b444228-0391-453e-aad2-cae27d4b2426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60ead2-bdee-468e-9dd8-916201bae64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60ead2-bdee-468e-9dd8-916201bae64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2060658743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e347dd0-ddd6-47d2-be9a-6962b815b18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69537d43341f41bdb529251ba7cb5709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:26Z,use_quota=True,user_id='876e7351a4ac434c98b30fafcb4af332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffea015-1d21-4b71-a9c5-0389c0caa700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffea015-1d21-4b71-a9c5-0389c0caa700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b84b8-14ad-4f89-9a5f-b32f8e231f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd0b84b8-14ad-4f89-9a5f-b32f8e231f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e347dd0-ddd6-47d2-be9a-6962b815b18e', 'volume_name': 'volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5138edc0-17f2-4a00-a632-b60ba41b8c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5138edc0-17f2-4a00-a632-b60ba41b8c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9530465f-52b7-4e5e-8612-09a9090d9f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Volume 5e347dd0-ddd6-47d2-be9a-6962b815b18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e', 'volume_size': 1} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2060658743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e347dd0-ddd6-47d2-be9a-6962b815b18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69537d43341f41bdb529251ba7cb5709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:26Z,use_quota=True,user_id='876e7351a4ac434c98b30fafcb4af332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Creating volume 5e347dd0-ddd6-47d2-be9a-6962b815b18e {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:29:26 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:26 devstack sudo[109333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e 1073741824 Aug 17 16:29:26 devstack sudo[109333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Flow 'volume_create_manager' (5c6f5827-62cb-4a7c-a0b5-f7b6ebd4f11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cb2be-2bac-46b9-a061-de9c543a3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471cb2be-2bac-46b9-a061-de9c543a3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-72513092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c6e70e-dfd7-40ba-9131-da8bd2c480e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac75a55431fa411c9edf4c777ef10fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:26Z,use_quota=True,user_id='abfceb12977f4447aa27449127ee3eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335d6c8-574d-42f7-b139-373fe126b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0335d6c8-574d-42f7-b139-373fe126b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b673fa-634a-46d4-b46f-6f8ce5b8f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b673fa-634a-46d4-b46f-6f8ce5b8f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c6e70e-dfd7-40ba-9131-da8bd2c480e3', 'volume_name': 'volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdefccd-e931-4e09-9744-bf9c3158ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdefccd-e931-4e09-9744-bf9c3158ec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c7c510-dce1-4671-b222-2abf56539fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Volume b6c6e70e-dfd7-40ba-9131-da8bd2c480e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3', 'volume_size': 1} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:26 devstack sudo[109333]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e 1073741824" returned: 0 in 0.708s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:26 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e Aug 17 16:29:26 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:27 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e" returned: 0 in 0.310s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-72513092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c6e70e-dfd7-40ba-9131-da8bd2c480e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac75a55431fa411c9edf4c777ef10fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:26Z,use_quota=True,user_id='abfceb12977f4447aa27449127ee3eed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Creating volume b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:29:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9530465f-52b7-4e5e-8612-09a9090d9f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6cc93b-ae13-4df1-b5d8-c16e25e8c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:27 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 1073741824 Aug 17 16:29:27 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Volume volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e (5e347dd0-ddd6-47d2-be9a-6962b815b18e): created successfully Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6cc93b-ae13-4df1-b5d8-c16e25e8c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Flow 'volume_create_manager' (4b444228-0391-453e-aad2-cae27d4b2426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-266e3241-09b3-4b7d-8776-6d0b7e5ea7aa tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Created volume successfully. Aug 17 16:29:27 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 1073741824" returned: 0 in 0.637s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:27 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:29:27 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:28 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c7c510-dce1-4671-b222-2abf56539fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9065098d-affe-4091-84ea-7df6308aff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Volume volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 (b6c6e70e-dfd7-40ba-9131-da8bd2c480e3): created successfully Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9065098d-affe-4091-84ea-7df6308aff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Flow 'volume_create_manager' (5c6f5827-62cb-4a7c-a0b5-f7b6ebd4f11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b949a3d0-13a8-435e-b0bb-2ca67469552e tempest-TestImageHashVerification-1848306216 None] Created volume successfully. Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-9002c5b1-340a-40ef-b43c-a6e9991f5b10 req-9477327e-0ee1-49f0-bade-0539da4fb5c9 tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-9002c5b1-340a-40ef-b43c-a6e9991f5b10 req-9477327e-0ee1-49f0-bade-0539da4fb5c9 tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-9002c5b1-340a-40ef-b43c-a6e9991f5b10 req-9477327e-0ee1-49f0-bade-0539da4fb5c9 tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-9002c5b1-340a-40ef-b43c-a6e9991f5b10 req-9477327e-0ee1-49f0-bade-0539da4fb5c9 tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c23c3c30-aa1a-4998-9b5d-f2a0fe18ae91', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:29:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-9002c5b1-340a-40ef-b43c-a6e9991f5b10 req-9477327e-0ee1-49f0-bade-0539da4fb5c9 tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] attachment_update completed successfully. Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95fe2e-cf31-434f-9ae7-42c44f810bc9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:31 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:29:31 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:31 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.477s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[12097508-ec23-4b6d-abda-142125542461]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:31 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:29:31 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:32 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.488s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 /opt/stack/data/cinder/conversion/b6c6e70e-dfd7-40ba-9131-da8bd2c480e3.temp_image.30617c8c-2814-43df-92d5-6106c2b2458axbp6kzyy.img {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:32 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 /opt/stack/data/cinder/conversion/b6c6e70e-dfd7-40ba-9131-da8bd2c480e3.temp_image.30617c8c-2814-43df-92d5-6106c2b2458axbp6kzyy.img Aug 17 16:29:32 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:34 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=65,cinder:UPDATE=58,cinder:DELETE=2,cinder:INSERT=12 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:29:34 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=55,cinder:SELECT=65,cinder:INSERT=17,cinder:DELETE=8 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:29:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-85f81f8c-c2c9-4638-8d04-1701d8fdcf8b req-c4bcdd20-dc4f-4a80-ad48-09991eece80c tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Terminate volume connection completed successfully. Aug 17 16:29:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-85f81f8c-c2c9-4638-8d04-1701d8fdcf8b req-c4bcdd20-dc4f-4a80-ad48-09991eece80c tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Deleting attachment c23c3c30-aa1a-4998-9b5d-f2a0fe18ae91. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:29:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "cinder-5e347dd0-ddd6-47d2-be9a-6962b815b18e-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "cinder-5e347dd0-ddd6-47d2-be9a-6962b815b18e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "cinder-quobyte-5e347dd0-ddd6-47d2-be9a-6962b815b18e" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:29:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "cinder-quobyte-5e347dd0-ddd6-47d2-be9a-6962b815b18e" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:29:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7355d21-0e00-41dd-bf44-aabad110afe7]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:36 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e Aug 17 16:29:36 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:37 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e" returned: 0 in 1.019s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:37 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e Aug 17 16:29:37 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:38 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e347dd0-ddd6-47d2-be9a-6962b815b18e" returned: 0 in 0.812s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "cinder-quobyte-5e347dd0-ddd6-47d2-be9a-6962b815b18e" released by "delete_volume" :: held 1.924s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Created reservations ['94a7adc6-39c4-4478-b7c6-b6069d18e3b7', '08187d9a-1bba-453c-b82c-936e4682aa24', '64227921-26e9-42a6-b109-0e8e62318c80', '8a4438ff-08b4-42f1-af08-ef077f81b4b5'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:38 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:29:38 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:38 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 /opt/stack/data/cinder/conversion/b6c6e70e-dfd7-40ba-9131-da8bd2c480e3.temp_image.30617c8c-2814-43df-92d5-6106c2b2458axbp6kzyy.img" returned: 0 in 6.834s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[245a3bb7-32fd-44f6-9dd6-00da26705364]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:29:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:39 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.549s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:29:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Deleted volume successfully. Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-82d69a5b-503f-44fa-b9fd-7909bc623f5d tempest-TestServerVolumeAttachScenarioOldVersion-300772133 None] Lock "cinder-5e347dd0-ddd6-47d2-be9a-6962b815b18e-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:29:39 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:29:39 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:39 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.719s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/conversion/b6c6e70e-dfd7-40ba-9131-da8bd2c480e3.temp_image.30617c8c-2814-43df-92d5-6106c2b2458axbp6kzyy.img {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:29:39 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Converted 1024.00 MB image at 149.75 MB/s Aug 17 16:29:39 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] 30617c8c-2814-43df-92d5-6106c2b2458a was raw, no need to convert to raw {{(pid=94468) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:29:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:29:46 devstack sudo[109558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:29:46 devstack sudo[109558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:29:47 devstack sudo[109558]: pam_unix(sudo:session): session closed for user root Aug 17 16:29:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:29:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:29:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:29:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:29:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:29:49 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:29:49 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Flow 'volume_create_manager' (75fe7545-e31a-4a0e-a1a5-6001bd6fec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdba9ce-2581-41e5-8066-2d7a3c43945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bdba9ce-2581-41e5-8066-2d7a3c43945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-501285261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300a035d-b62b-4e53-aa68-bbea5f304f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e37483d6f9432696f94b43b55db666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:55Z,use_quota=True,user_id='24886db8e3af45169a39fda493f62684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc96a23-dc33-42a1-98a4-b399717fe8d3),volume_type_id=0bc96a23-dc33-42a1-98a4-b399717fe8d3)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e241cd-0672-4095-abfd-f2cbaa7bb32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e241cd-0672-4095-abfd-f2cbaa7bb32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a90c4b-e8e0-4fce-9ab6-2b1bd5bc9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a90c4b-e8e0-4fce-9ab6-2b1bd5bc9784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300a035d-b62b-4e53-aa68-bbea5f304f5e', 'volume_name': 'volume-300a035d-b62b-4e53-aa68-bbea5f304f5e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c362d14-0684-4bc8-b9ca-a956dc151d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c362d14-0684-4bc8-b9ca-a956dc151d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af8b2e7-126d-4d80-acbf-1a6e35f70586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:29:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Volume 300a035d-b62b-4e53-aa68-bbea5f304f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300a035d-b62b-4e53-aa68-bbea5f304f5e', 'volume_size': 1} Aug 17 16:29:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (eb1b5221-8a4c-45ec-9a4f-c45ec2bbf7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a32d15e-3c71-43fb-993f-d31e8950e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a32d15e-3c71-43fb-993f-d31e8950e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485602218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe1e886-26c8-4c92-864d-247e04a83e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:05Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa1dc42-7907-4754-9c82-2fdf3c774945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fa1dc42-7907-4754-9c82-2fdf3c774945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ffc146-89a6-450a-881e-a9bd5d3cb819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ffc146-89a6-450a-881e-a9bd5d3cb819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fe1e886-26c8-4c92-864d-247e04a83e80', 'volume_name': 'volume-4fe1e886-26c8-4c92-864d-247e04a83e80', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d475b3e-d9c1-446c-98b4-b7c97ed78908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d475b3e-d9c1-446c-98b4-b7c97ed78908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8396e1a8-6fab-4ace-89e7-2a7837356abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume 4fe1e886-26c8-4c92-864d-247e04a83e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fe1e886-26c8-4c92-864d-247e04a83e80', 'volume_size': 1} Aug 17 16:30:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.536s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Uploaded volume to glance image-id: 30617c8c-2814-43df-92d5-6106c2b2458a. {{(pid=94468) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.734s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-501285261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300a035d-b62b-4e53-aa68-bbea5f304f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e37483d6f9432696f94b43b55db666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:29:55Z,use_quota=True,user_id='24886db8e3af45169a39fda493f62684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bc96a23-dc33-42a1-98a4-b399717fe8d3),volume_type_id=0bc96a23-dc33-42a1-98a4-b399717fe8d3)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Creating volume 300a035d-b62b-4e53-aa68-bbea5f304f5e {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:06 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ffa0651d-0d03-4628-b0f9-1e7297b08bcf tempest-TestImageHashVerification-1848306216 None] Copy volume to image completed successfully. Aug 17 16:30:06 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e 1073741824 Aug 17 16:30:06 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:07 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e 1073741824" returned: 0 in 0.609s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:07 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e Aug 17 16:30:07 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:07 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e" returned: 0 in 0.333s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-485602218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fe1e886-26c8-4c92-864d-247e04a83e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:05Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume 4fe1e886-26c8-4c92-864d-247e04a83e80 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:07 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af8b2e7-126d-4d80-acbf-1a6e35f70586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300a035d-b62b-4e53-aa68-bbea5f304f5e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:07 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 1073741824 Aug 17 16:30:07 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e543abc7-4bbe-4e6b-8e73-4536493d34c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:07 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Volume volume-300a035d-b62b-4e53-aa68-bbea5f304f5e (300a035d-b62b-4e53-aa68-bbea5f304f5e): created successfully Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e543abc7-4bbe-4e6b-8e73-4536493d34c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Flow 'volume_create_manager' (75fe7545-e31a-4a0e-a1a5-6001bd6fec0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-cb2f8ba3-392e-4e59-a378-743d3aab3314 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Created volume successfully. Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Acquiring lock "cinder-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "cinder-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Acquiring lock "cinder-quobyte-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "cinder-quobyte-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[635bc576-c8fa-4292-9303-839412d40e58]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:08 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:30:08 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:08 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 1073741824" returned: 0 in 0.684s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:08 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 Aug 17 16:30:08 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:08 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.528s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:08 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3 Aug 17 16:30:08 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:08 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8396e1a8-6fab-4ace-89e7-2a7837356abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fe1e886-26c8-4c92-864d-247e04a83e80', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710df855-1e43-4fca-89ec-d4334ff040fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:08 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-4fe1e886-26c8-4c92-864d-247e04a83e80 (4fe1e886-26c8-4c92-864d-247e04a83e80): created successfully Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710df855-1e43-4fca-89ec-d4334ff040fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:08 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (eb1b5221-8a4c-45ec-9a4f-c45ec2bbf7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" returned: 0 in 0.405s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-486c549a-ab10-4426-9241-67f6bb81bcb0 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "cinder-quobyte-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3" released by "delete_volume" :: held 0.997s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Created reservations ['394e7b26-ec11-46ae-936f-2e8e2c3c2fd1', '6236a536-f26f-43d1-9490-e2504ad2ab58', '2c802337-ca71-4848-97c4-d3e6b9c06210', '22a70d2e-be9c-4649-ab94-afbc9dc850ff'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:09 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:09 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:09 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:09 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-b428e493-6488-4eae-8f5f-d7021e46c4bd req-ede88af6-ea9b-44f9-83cf-051d0da68002 tempest-TestMinimumBasicScenario-536596805 None] Terminate volume connection completed successfully. Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-b428e493-6488-4eae-8f5f-d7021e46c4bd req-ede88af6-ea9b-44f9-83cf-051d0da68002 tempest-TestMinimumBasicScenario-536596805 None] Deleting attachment bb011d3b-ff98-4e58-8c18-2f8b1f51cf52. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:30:09 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.378s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Deleted volume successfully. Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-797d4e4c-80e8-4443-a7a3-0ed1ba997e51 tempest-TestImageHashVerification-1848306216 None] Lock "cinder-b6c6e70e-dfd7-40ba-9131-da8bd2c480e3-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:09 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1d5330b1-b081-4f6f-8966-fc43fa518690 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Retype volume completed successfully. Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (6432d0de-b4c3-46e8-81a2-3ec56955b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd8d089-3450-48bb-ab4e-f9b7d82dde4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd8d089-3450-48bb-ab4e-f9b7d82dde4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864826611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba221a5d-7557-420d-ac4b-9492f115a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:10Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d8204b-9b9e-486e-978f-dbe735316329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d8204b-9b9e-486e-978f-dbe735316329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a9b65a-e2e8-4038-bef0-04075141ece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a9b65a-e2e8-4038-bef0-04075141ece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba221a5d-7557-420d-ac4b-9492f115a699', 'volume_name': 'volume-ba221a5d-7557-420d-ac4b-9492f115a699', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96f11d-0cd8-4381-86fc-08c2851e7548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf96f11d-0cd8-4381-86fc-08c2851e7548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98624112-9e8c-4e42-ad3d-4847985c6589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:09 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume ba221a5d-7557-420d-ac4b-9492f115a699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba221a5d-7557-420d-ac4b-9492f115a699', 'volume_size': 1} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1864826611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba221a5d-7557-420d-ac4b-9492f115a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:10Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume ba221a5d-7557-420d-ac4b-9492f115a699 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:09 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "cinder-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:09 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 1073741824 Aug 17 16:30:09 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "cinder-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "cinder-quobyte-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "cinder-quobyte-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835f4a7-ca1f-4cf2-b99d-0d749e066be2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:10 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 Aug 17 16:30:10 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (82629ce0-a04f-4ee9-9a44-7c03f26ec83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62a43a9-d546-4973-9c36-06336676c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62a43a9-d546-4973-9c36-06336676c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890608188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84204a70-bbc3-493c-a396-b20521ca8240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:10Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c62d0f-a185-4fe2-b0b3-77ef1a5869a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c62d0f-a185-4fe2-b0b3-77ef1a5869a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c590ad5-53c4-4a25-a5a6-b0e94ae345b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c590ad5-53c4-4a25-a5a6-b0e94ae345b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84204a70-bbc3-493c-a396-b20521ca8240', 'volume_name': 'volume-84204a70-bbc3-493c-a396-b20521ca8240', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9338a8b-4d37-4102-99ee-5a498d0d18cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9338a8b-4d37-4102-99ee-5a498d0d18cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b2cef-9f3f-4f72-ae17-fe8f0c847672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:10 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume 84204a70-bbc3-493c-a396-b20521ca8240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84204a70-bbc3-493c-a396-b20521ca8240', 'volume_size': 1} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:10 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" returned: 0 in 0.524s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:10 devstack sudo[109638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1 Aug 17 16:30:10 devstack sudo[109638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:10 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 1073741824" returned: 0 in 0.877s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "cinder-300a035d-b62b-4e53-aa68-bbea5f304f5e-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "cinder-300a035d-b62b-4e53-aa68-bbea5f304f5e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "cinder-quobyte-300a035d-b62b-4e53-aa68-bbea5f304f5e" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:10 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 Aug 17 16:30:10 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (9f21a027-ee99-4b09-9bda-d8d00e60f555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722e1127-2e9b-41ba-9788-fad3e239df97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "cinder-quobyte-300a035d-b62b-4e53-aa68-bbea5f304f5e" acquired by "delete_volume" :: waited 0.069s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722e1127-2e9b-41ba-9788-fad3e239df97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528236020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9edfd7-717d-4ac2-a84a-7b810c404f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:11Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a223a072-afe7-46e6-9857-bfa6c37dab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a223a072-afe7-46e6-9857-bfa6c37dab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc337fce-9ef8-45e0-abbf-0e7ede2cf916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc337fce-9ef8-45e0-abbf-0e7ede2cf916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9edfd7-717d-4ac2-a84a-7b810c404f28', 'volume_name': 'volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab3bcd7-06fd-4fec-9812-479580a1ff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab3bcd7-06fd-4fec-9812-479580a1ff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5fab98-f631-46a7-9e7b-632dc0b32a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume ed9edfd7-717d-4ac2-a84a-7b810c404f28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28', 'volume_size': 1} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7a5bd6-db15-4125-b353-1058d10efda3]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:11 devstack sudo[109638]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" returned: 0 in 0.655s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "cinder-quobyte-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1" released by "delete_volume" :: held 1.298s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:11 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699" returned: 0 in 0.502s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.078s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1890608188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84204a70-bbc3-493c-a396-b20521ca8240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:10Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume 84204a70-bbc3-493c-a396-b20521ca8240 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:11 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:11 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e Aug 17 16:30:11 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:11 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 1073741824 Aug 17 16:30:11 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98624112-9e8c-4e42-ad3d-4847985c6589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba221a5d-7557-420d-ac4b-9492f115a699', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdfbdf6-1e61-431e-ba72-d2279dceb69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-ba221a5d-7557-420d-ac4b-9492f115a699 (ba221a5d-7557-420d-ac4b-9492f115a699): created successfully Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdfbdf6-1e61-431e-ba72-d2279dceb69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (6432d0de-b4c3-46e8-81a2-3ec56955b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6f89a63e-e563-43ef-aae1-6c4285140409 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Created reservations ['3f8415f2-fd3d-41f2-8eb1-22cf75b5de7e', '081ec12d-27aa-4df3-b434-00e695c73c54', '9c514a73-aa69-4da1-a380-20d7e2401f4c', '6b94a237-6f7f-4f85-9cd7-a42855a9a7ed'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (66565933-2e83-48e1-be53-f59ef631a69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed7c4c0-f917-49fb-916f-16fc862cf665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed7c4c0-f917-49fb-916f-16fc862cf665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703044583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d3a0c3-1350-46a4-a621-e61da215b2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:12Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daf8131-3a94-4420-8ccb-f41e487608af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5daf8131-3a94-4420-8ccb-f41e487608af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c2054e-25d5-43d5-98da-79edbb4d4d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c2054e-25d5-43d5-98da-79edbb4d4d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d3a0c3-1350-46a4-a621-e61da215b2be', 'volume_name': 'volume-23d3a0c3-1350-46a4-a621-e61da215b2be', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3569cb81-2cb6-41e7-8eb1-f177d8e1e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3569cb81-2cb6-41e7-8eb1-f177d8e1e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581fc5c-f2b8-4a22-a5e6-57824f5e7a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:11 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume 23d3a0c3-1350-46a4-a621-e61da215b2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d3a0c3-1350-46a4-a621-e61da215b2be', 'volume_size': 1} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e" returned: 0 in 0.711s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:11 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e Aug 17 16:30:11 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:11 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:11 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:12 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-300a035d-b62b-4e53-aa68-bbea5f304f5e" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "cinder-quobyte-300a035d-b62b-4e53-aa68-bbea5f304f5e" released by "delete_volume" :: held 1.265s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:12 devstack cinder-volume[94468]: WARNING cinder.quota [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:30:12 devstack cinder-volume[94468]: WARNING cinder.quota [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:30:12 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:12 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:12 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Deleted volume successfully. Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 1073741824" returned: 0 in 0.993s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Created reservations ['6dcff045-a67a-42ff-92ea-d7e0360f6718', '9f9129a4-221a-4cd8-a0f8-885bac791ffd', '39677e96-1716-479e-86c8-6c96fb33d69d', '6814ed0a-e795-4a31-b511-863fdc116c2c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (c3917ff6-61f8-42d2-944a-b5895fd64733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6386f1c-2bb3-4903-83f1-d53979165a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4d670310-c559-4b1b-b9b0-9616fbc4f328 tempest-TestMinimumBasicScenario-536596805 None] Lock "cinder-5b8fb30b-a9fc-4cd7-968d-1a4d29e06de1-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6386f1c-2bb3-4903-83f1-d53979165a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1537156483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee063ca3-3752-4529-b400-3060cdcedda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:12Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1229473-1a92-4a1a-9187-aa26e4be13fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1229473-1a92-4a1a-9187-aa26e4be13fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeaf628-ab84-456b-bc10-286680314a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeaf628-ab84-456b-bc10-286680314a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee063ca3-3752-4529-b400-3060cdcedda1', 'volume_name': 'volume-ee063ca3-3752-4529-b400-3060cdcedda1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e743a-79f9-460d-afdc-aef66fc0818c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9e743a-79f9-460d-afdc-aef66fc0818c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaee9a9a-8c57-48d7-b855-123262829955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:12 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume ee063ca3-3752-4529-b400-3060cdcedda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee063ca3-3752-4529-b400-3060cdcedda1', 'volume_size': 1} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:12 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 Aug 17 16:30:12 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:12 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:12 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:13 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240" returned: 0 in 0.497s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-528236020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9edfd7-717d-4ac2-a84a-7b810c404f28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:11Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume ed9edfd7-717d-4ac2-a84a-7b810c404f28 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:13 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:13 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:13 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 1073741824 Aug 17 16:30:13 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98b2cef-9f3f-4f72-ae17-fe8f0c847672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84204a70-bbc3-493c-a396-b20521ca8240', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e3dcb3-7f86-43d3-bc32-29e7e21259dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.588s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Deleted volume successfully. Aug 17 16:30:13 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-84204a70-bbc3-493c-a396-b20521ca8240 (84204a70-bbc3-493c-a396-b20521ca8240): created successfully Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e3dcb3-7f86-43d3-bc32-29e7e21259dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (82629ce0-a04f-4ee9-9a44-7c03f26ec83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8c45ca3b-0eca-482c-8a06-6ab320c40dc9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-937bb68c-5523-443f-bab0-0d5b32940798 tempest-VolumeRetypeWithoutMigrationTest-540837539 None] Lock "cinder-300a035d-b62b-4e53-aa68-bbea5f304f5e-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:13 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 1073741824" returned: 0 in 0.679s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:14 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 Aug 17 16:30:14 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:14 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.582s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703044583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d3a0c3-1350-46a4-a621-e61da215b2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:12Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume 23d3a0c3-1350-46a4-a621-e61da215b2be {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:14 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:14 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be 1073741824 Aug 17 16:30:14 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5fab98-f631-46a7-9e7b-632dc0b32a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88fc470-1654-4aaa-b32e-fc41b1e0aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:14 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 (ed9edfd7-717d-4ac2-a84a-7b810c404f28): created successfully Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88fc470-1654-4aaa-b32e-fc41b1e0aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (9f21a027-ee99-4b09-9bda-d8d00e60f555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8aa38ff5-50b8-4fa2-8d0f-2af423f1bd4d tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:15 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be 1073741824" returned: 0 in 0.697s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:15 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be Aug 17 16:30:15 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:15 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be" returned: 0 in 0.291s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.831s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1537156483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee063ca3-3752-4529-b400-3060cdcedda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38759e5eed554ac2b729e4d167491327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:12Z,use_quota=True,user_id='fb524b185cf24dc381ebf1893218705c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Creating volume ee063ca3-3752-4529-b400-3060cdcedda1 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:15 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:15 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 1073741824 Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d581fc5c-f2b8-4a22-a5e6-57824f5e7a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d3a0c3-1350-46a4-a621-e61da215b2be', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:15 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d04a1c-2ab8-451e-95a0-8e574444635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:15 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-23d3a0c3-1350-46a4-a621-e61da215b2be (23d3a0c3-1350-46a4-a621-e61da215b2be): created successfully Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d04a1c-2ab8-451e-95a0-8e574444635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (66565933-2e83-48e1-be53-f59ef631a69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-509e4a39-baad-44bf-b9da-2534f200a894 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:16 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 1073741824" returned: 0 in 0.580s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:16 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 Aug 17 16:30:16 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:16 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1" returned: 0 in 0.362s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaee9a9a-8c57-48d7-b855-123262829955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee063ca3-3752-4529-b400-3060cdcedda1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3f177d-065a-4282-b1fb-78ed983bdbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:16 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Volume volume-ee063ca3-3752-4529-b400-3060cdcedda1 (ee063ca3-3752-4529-b400-3060cdcedda1): created successfully Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3f177d-065a-4282-b1fb-78ed983bdbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Flow 'volume_create_manager' (c3917ff6-61f8-42d2-944a-b5895fd64733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:16 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-95d22107-6db1-4325-90f5-ded6df041b6b tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created volume successfully. Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-ee063ca3-3752-4529-b400-3060cdcedda1-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ee063ca3-3752-4529-b400-3060cdcedda1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-ee063ca3-3752-4529-b400-3060cdcedda1" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ee063ca3-3752-4529-b400-3060cdcedda1" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76e2abe-991f-4d50-a814-9b5e716e5927]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:17 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 Aug 17 16:30:17 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:17 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1" returned: 0 in 0.438s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:17 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1 Aug 17 16:30:17 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:17 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ee063ca3-3752-4529-b400-3060cdcedda1" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ee063ca3-3752-4529-b400-3060cdcedda1" released by "delete_volume" :: held 0.832s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['c4ee376e-dc58-42a3-a687-e863bb761de8', '5f042cf4-0026-4c47-9864-05a56406f0e4', '4cbf33d2-2dbf-4f27-a45d-a21c0b8ae1aa', 'b7979c29-a09a-48a2-99b2-b894b9fdff8f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:18 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:18 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-23d3a0c3-1350-46a4-a621-e61da215b2be-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-23d3a0c3-1350-46a4-a621-e61da215b2be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-23d3a0c3-1350-46a4-a621-e61da215b2be" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-23d3a0c3-1350-46a4-a621-e61da215b2be" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[21075674-27c7-47ab-a160-1e560a16a9c2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:18 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.445s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fdcb277f-a856-441c-b0dc-268d58fae48f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ee063ca3-3752-4529-b400-3060cdcedda1-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:18 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be Aug 17 16:30:18 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:19 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:19 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be Aug 17 16:30:19 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:19 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-23d3a0c3-1350-46a4-a621-e61da215b2be" returned: 0 in 0.342s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-23d3a0c3-1350-46a4-a621-e61da215b2be" released by "delete_volume" :: held 0.921s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['62d361d9-9323-46a6-af73-d7250d27f29d', '72e0f56a-333a-4ee5-8fde-84f109e02341', 'd843dcdc-78a4-4441-8b66-e3e2d162d75d', '8ed5d9b6-dc67-40b7-b353-1c622b3e0e8f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:19 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:19 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:20 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.335s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2c2a2ce2-742f-47a8-a756-c63c024419c9 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-23d3a0c3-1350-46a4-a621-e61da215b2be-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-ed9edfd7-717d-4ac2-a84a-7b810c404f28-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ed9edfd7-717d-4ac2-a84a-7b810c404f28-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-ed9edfd7-717d-4ac2-a84a-7b810c404f28" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ed9edfd7-717d-4ac2-a84a-7b810c404f28" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[321b97d0-9c08-4caf-855b-ba10c6efd2cf]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:21 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 Aug 17 16:30:21 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:21 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:21 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28 Aug 17 16:30:21 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:21 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ed9edfd7-717d-4ac2-a84a-7b810c404f28" returned: 0 in 0.385s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ed9edfd7-717d-4ac2-a84a-7b810c404f28" released by "delete_volume" :: held 0.910s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['8d1b546e-d26a-40f7-861d-663eab17494d', '844d1475-60f0-4abe-b40c-c35f28e0b748', 'b9fd5c75-2e93-4966-8d90-fddc2ba6a122', '0ee0bb72-8046-48fc-a302-4bcff9de231d'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:22 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:22 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Flow 'volume_create_manager' (726e189f-11ca-4acd-8da0-c441aaf454ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ef4636-ea58-4d2a-958e-329f0274a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ef4636-ea58-4d2a-958e-329f0274a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-516292710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c26ff0-a231-4775-932d-b953d7527c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32e90d07774c3faba5b2e8635a02d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:22Z,use_quota=True,user_id='714c23199b8646daa5f5c8246310408e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00e6a5a-b89f-406b-8239-d756a07fffd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:22 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00e6a5a-b89f-406b-8239-d756a07fffd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0290d7-4680-4cce-a70c-f636f9b7be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0290d7-4680-4cce-a70c-f636f9b7be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c26ff0-a231-4775-932d-b953d7527c18', 'volume_name': 'volume-d3c26ff0-a231-4775-932d-b953d7527c18', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfe12a8-98c4-4f4c-98f0-5f604b97c904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfe12a8-98c4-4f4c-98f0-5f604b97c904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d410af-624b-4d2b-85ce-b4959603bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Volume d3c26ff0-a231-4775-932d-b953d7527c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c26ff0-a231-4775-932d-b953d7527c18', 'volume_size': 1} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-516292710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c26ff0-a231-4775-932d-b953d7527c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca32e90d07774c3faba5b2e8635a02d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:22Z,use_quota=True,user_id='714c23199b8646daa5f5c8246310408e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Creating volume d3c26ff0-a231-4775-932d-b953d7527c18 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:22 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.414s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:22 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 1073741824 Aug 17 16:30:22 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-16dd209a-8313-4a75-b132-730e28c864a2 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ed9edfd7-717d-4ac2-a84a-7b810c404f28-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:22 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 1073741824" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:22 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 Aug 17 16:30:22 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-84204a70-bbc3-493c-a396-b20521ca8240-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-84204a70-bbc3-493c-a396-b20521ca8240-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-84204a70-bbc3-493c-a396-b20521ca8240" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-84204a70-bbc3-493c-a396-b20521ca8240" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e3e9f-8b9e-4167-8138-ac58753b75b7]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:23 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18" returned: 0 in 0.493s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:23 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 Aug 17 16:30:23 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d410af-624b-4d2b-85ce-b4959603bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c26ff0-a231-4775-932d-b953d7527c18', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8f955-5811-4c3c-9a71-20703c6fd9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Volume volume-d3c26ff0-a231-4775-932d-b953d7527c18 (d3c26ff0-a231-4775-932d-b953d7527c18): created successfully Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e8f955-5811-4c3c-9a71-20703c6fd9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Flow 'volume_create_manager' (726e189f-11ca-4acd-8da0-c441aaf454ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-80290e46-063c-4204-aac9-1204bad174f2 tempest-VolumesServicesTestJSON-1439716154 None] Created volume successfully. Aug 17 16:30:23 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240" returned: 0 in 0.539s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:23 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240 Aug 17 16:30:23 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:24 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-84204a70-bbc3-493c-a396-b20521ca8240" returned: 0 in 0.275s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-84204a70-bbc3-493c-a396-b20521ca8240" released by "delete_volume" :: held 0.886s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['9b7aaf67-971a-403a-90e3-d6e1f2bb04de', '1fee22c4-f4c0-4e38-b30d-6db02a5f121d', 'c528c2a1-8610-4454-b5a3-6f09d48dc74f', '133736db-fb6e-4b82-ba1d-e002d80ac2b6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:24 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:24 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-ba221a5d-7557-420d-ac4b-9492f115a699-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ba221a5d-7557-420d-ac4b-9492f115a699-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-ba221a5d-7557-420d-ac4b-9492f115a699" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ba221a5d-7557-420d-ac4b-9492f115a699" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a25216-dc08-45b6-b9df-c559f84aaf59]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Acquiring lock "cinder-d3c26ff0-a231-4775-932d-b953d7527c18-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "cinder-d3c26ff0-a231-4775-932d-b953d7527c18-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Acquiring lock "cinder-quobyte-d3c26ff0-a231-4775-932d-b953d7527c18" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "cinder-quobyte-d3c26ff0-a231-4775-932d-b953d7527c18" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:24 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 Aug 17 16:30:24 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[627a8c04-e3cc-4c30-b25e-a4453e1a6833]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:24 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.556s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1ef58d2a-7f07-41b2-bdc3-2388acff6161 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-84204a70-bbc3-493c-a396-b20521ca8240-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:24 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 Aug 17 16:30:24 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:25 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699" returned: 0 in 0.589s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:25 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699 Aug 17 16:30:25 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:25 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:25 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18 Aug 17 16:30:25 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:25 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ba221a5d-7557-420d-ac4b-9492f115a699" returned: 0 in 0.333s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-ba221a5d-7557-420d-ac4b-9492f115a699" released by "delete_volume" :: held 0.996s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['a5ade3ce-c8da-45a1-8fba-2c48a91f6304', '93333921-aadb-4ae9-a1fd-5443023dc82d', 'd222f039-62d9-4d5e-a45c-6fb4ccc45b64', '9d6f7828-9152-4cee-98d3-019a8c2bccb5'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:25 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d3c26ff0-a231-4775-932d-b953d7527c18" returned: 0 in 0.346s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "cinder-quobyte-d3c26ff0-a231-4775-932d-b953d7527c18" released by "delete_volume" :: held 0.886s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:25 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:25 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Created reservations ['80cdf28e-ab23-4759-a323-c8beceecd4cf', 'dd8f65a8-9491-4005-99a6-971c82452b5b', '84e380c8-a03f-4f5d-8ed0-e99450e12e3c', '1b07c1a3-3a29-4a33-9e71-3dbae392b495'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:25 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:25 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:26 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.380s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-581b555f-fb3d-4552-9c2b-4a0f1084baf1 tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-ba221a5d-7557-420d-ac4b-9492f115a699-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:26 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.305s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Deleted volume successfully. Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99f4dc87-fa11-4275-bfd1-4504bec1fab9 tempest-VolumesServicesTestJSON-1439716154 None] Lock "cinder-d3c26ff0-a231-4775-932d-b953d7527c18-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-4fe1e886-26c8-4c92-864d-247e04a83e80-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-4fe1e886-26c8-4c92-864d-247e04a83e80-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "cinder-quobyte-4fe1e886-26c8-4c92-864d-247e04a83e80" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-4fe1e886-26c8-4c92-864d-247e04a83e80" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a747103d-ce0b-4423-aaad-4ffdca0d89fa]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:26 devstack sudo[109807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 Aug 17 16:30:26 devstack sudo[109807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:27 devstack sudo[109807]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:27 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80 Aug 17 16:30:27 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:27 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fe1e886-26c8-4c92-864d-247e04a83e80" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-quobyte-4fe1e886-26c8-4c92-864d-247e04a83e80" released by "delete_volume" :: held 0.831s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Created reservations ['b9b8d7f5-7268-4da3-bf72-3c68993168a9', 'ecc9a1a7-c958-447a-a158-ce352216cf93', 'd53267d4-9c09-490c-acf2-7847a8a8673c', '43a9c7df-7821-4691-8fef-f15e8874cbb9'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:27 devstack sudo[109815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:27 devstack sudo[109815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:28 devstack sudo[109815]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.358s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:28 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Deleted volume successfully. Aug 17 16:30:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7f19e854-c0a5-4b22-936c-ebbc4c100c5f tempest-CreateVolumesFromSourceVolumeTest-70009860 None] Lock "cinder-4fe1e886-26c8-4c92-864d-247e04a83e80-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Flow 'volume_create_manager' (7496ef63-32df-48a9-9c46-6c9fe42dffe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4255c841-8ab4-470c-a6d1-13d3ee6fe08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4255c841-8ab4-470c-a6d1-13d3ee6fe08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543212180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0006f4-3e14-4eb2-a036-974dff7a49c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfe2f88cc37447fb18d90623f7894c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:34Z,use_quota=True,user_id='8c090a847af84963ad08490534e7802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b4452-a130-47c1-98a4-9f699fbfe028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3b4452-a130-47c1-98a4-9f699fbfe028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ed00b4-dff9-4078-8420-a176fcb5baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7ed00b4-dff9-4078-8420-a176fcb5baba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0006f4-3e14-4eb2-a036-974dff7a49c4', 'volume_name': 'volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b62e5c7-84a1-480d-bc45-03b81c1d444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b62e5c7-84a1-480d-bc45-03b81c1d444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e89e3d-b791-4b87-9fd4-473a3ff538af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Volume fd0006f4-3e14-4eb2-a036-974dff7a49c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4', 'volume_size': 1} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543212180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0006f4-3e14-4eb2-a036-974dff7a49c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfe2f88cc37447fb18d90623f7894c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:34Z,use_quota=True,user_id='8c090a847af84963ad08490534e7802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Creating volume fd0006f4-3e14-4eb2-a036-974dff7a49c4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:34 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:34 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 1073741824 Aug 17 16:30:34 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:35 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 1073741824" returned: 0 in 0.510s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:35 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 Aug 17 16:30:35 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:35 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4" returned: 0 in 0.337s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0e89e3d-b791-4b87-9fd4-473a3ff538af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9d3a32-722f-404a-8c6c-de803ae5ddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:35 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Volume volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 (fd0006f4-3e14-4eb2-a036-974dff7a49c4): created successfully Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9d3a32-722f-404a-8c6c-de803ae5ddc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Flow 'volume_create_manager' (7496ef63-32df-48a9-9c46-6c9fe42dffe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-25ff8421-60a7-4c61-98e8-e7f5227b8df2 tempest-ProjectReaderTests-930609166 None] Created volume successfully. Aug 17 16:30:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Acquiring lock "cinder-fd0006f4-3e14-4eb2-a036-974dff7a49c4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "cinder-fd0006f4-3e14-4eb2-a036-974dff7a49c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Acquiring lock "cinder-quobyte-fd0006f4-3e14-4eb2-a036-974dff7a49c4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "cinder-quobyte-fd0006f4-3e14-4eb2-a036-974dff7a49c4" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03bfca8-6a33-4ca4-b5d9-6a099775c93b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:37 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 Aug 17 16:30:37 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:37 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4" returned: 0 in 0.444s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:37 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4 Aug 17 16:30:37 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:37 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fd0006f4-3e14-4eb2-a036-974dff7a49c4" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "cinder-quobyte-fd0006f4-3e14-4eb2-a036-974dff7a49c4" released by "delete_volume" :: held 0.829s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Created reservations ['dfd83c21-a1a0-4a6b-96b8-a6cf7def031a', 'fc78ca41-80ef-46f1-b580-3bfe2ad3b2d5', 'd5c5f506-8f37-4682-a16c-c7f05e2a9d4f', 'd8da45a8-e84f-44c8-a0a4-5fba90b455d8'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:38 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:38 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:38 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.407s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Deleted volume successfully. Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e37d3e09-1aeb-4f6a-9120-f2f2cf0c48cd tempest-ProjectReaderTests-930609166 None] Lock "cinder-fd0006f4-3e14-4eb2-a036-974dff7a49c4-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Flow 'volume_create_manager' (a52f0978-665d-487a-8a63-1c668e151ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954410e7-c80b-4be4-a030-5931aea2f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (954410e7-c80b-4be4-a030-5931aea2f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691365117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd053b60-3abf-40c1-9c4a-b87f6e3fc804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfe2f88cc37447fb18d90623f7894c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:39Z,use_quota=True,user_id='8c090a847af84963ad08490534e7802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82744bda-c8e5-444c-9ef0-76d35245108d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82744bda-c8e5-444c-9ef0-76d35245108d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054e73e2-f4d0-4385-8178-502cc0be9515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054e73e2-f4d0-4385-8178-502cc0be9515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd053b60-3abf-40c1-9c4a-b87f6e3fc804', 'volume_name': 'volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba4aa46-f1f5-4b5a-9fd8-99a62ab21bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba4aa46-f1f5-4b5a-9fd8-99a62ab21bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eff4607-4b32-4fe1-a2ca-d7acd1cb413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Volume cd053b60-3abf-40c1-9c4a-b87f6e3fc804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804', 'volume_size': 1} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-691365117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd053b60-3abf-40c1-9c4a-b87f6e3fc804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfe2f88cc37447fb18d90623f7894c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:39Z,use_quota=True,user_id='8c090a847af84963ad08490534e7802f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Creating volume cd053b60-3abf-40c1-9c4a-b87f6e3fc804 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:39 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:39 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 1073741824 Aug 17 16:30:39 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:39 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 1073741824" returned: 0 in 0.794s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:39 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 Aug 17 16:30:40 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:40 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eff4607-4b32-4fe1-a2ca-d7acd1cb413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f44c6-a44e-46e4-a6bc-05b5fefc5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Volume volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 (cd053b60-3abf-40c1-9c4a-b87f6e3fc804): created successfully Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347f44c6-a44e-46e4-a6bc-05b5fefc5b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Flow 'volume_create_manager' (a52f0978-665d-487a-8a63-1c668e151ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3b8c12a6-56bf-4c2c-a975-9b35d04c1b9e tempest-ProjectReaderTests-930609166 None] Created volume successfully. Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (65c68854-2430-4da0-b4d0-58d186848e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475775cf-2a92-42d2-9be3-5efc1dcb8a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475775cf-2a92-42d2-9be3-5efc1dcb8a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1241019008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6860b158-260f-44d2-ad6c-87810686c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3732b2f2254ff4bb192a4bdb3c3a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:41Z,use_quota=True,user_id='6a165d44439245d08b3d2386e883dcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0413abcd-1f08-4bf7-a26a-17f011c19182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0413abcd-1f08-4bf7-a26a-17f011c19182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d68177-5b41-4955-8f3f-4db8345cd01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d68177-5b41-4955-8f3f-4db8345cd01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6860b158-260f-44d2-ad6c-87810686c076', 'volume_name': 'volume-6860b158-260f-44d2-ad6c-87810686c076', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8984e5f5-da96-461c-817b-66d33189579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8984e5f5-da96-461c-817b-66d33189579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0866c3be-8c95-4f41-a2a1-773f6867efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:40 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Volume 6860b158-260f-44d2-ad6c-87810686c076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6860b158-260f-44d2-ad6c-87810686c076', 'volume_size': 1} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1241019008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6860b158-260f-44d2-ad6c-87810686c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3732b2f2254ff4bb192a4bdb3c3a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:30:41Z,use_quota=True,user_id='6a165d44439245d08b3d2386e883dcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Creating volume 6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:30:40 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:30:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:41 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 1073741824 Aug 17 16:30:41 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Acquiring lock "cinder-cd053b60-3abf-40c1-9c4a-b87f6e3fc804-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "cinder-cd053b60-3abf-40c1-9c4a-b87f6e3fc804-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Acquiring lock "cinder-quobyte-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "cinder-quobyte-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c8b01a-9b2b-4855-97c2-cb73e43d0cd5]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:41 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 Aug 17 16:30:41 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:41 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 1073741824" returned: 0 in 0.723s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:41 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" returned: 0 in 0.583s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:41 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:41 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:41 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804 Aug 17 16:30:41 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:42 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.376s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0866c3be-8c95-4f41-a2a1-773f6867efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6860b158-260f-44d2-ad6c-87810686c076', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54219179-1a6d-43ac-8edb-d0e4458ce5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:42 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Volume volume-6860b158-260f-44d2-ad6c-87810686c076 (6860b158-260f-44d2-ad6c-87810686c076): created successfully Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54219179-1a6d-43ac-8edb-d0e4458ce5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (65c68854-2430-4da0-b4d0-58d186848e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" returned: 0 in 0.399s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "cinder-quobyte-cd053b60-3abf-40c1-9c4a-b87f6e3fc804" released by "delete_volume" :: held 1.061s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-706d88ef-2977-47d9-8d5a-cf538dec7878 tempest-VolumesDeleteCascade-209066889 None] Created volume successfully. Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Created reservations ['d41f6052-0d5d-4644-9725-cf26557bb17e', '74e9075b-5cc4-4d9b-b848-2510b05330b0', 'e27c2802-61c4-4be6-a752-c88eeba5dc3f', '0066605f-5e5d-42c0-8b55-daa85140cab8'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:42 devstack sudo[109909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:42 devstack sudo[109909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:42 devstack sudo[109909]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.295s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Deleted volume successfully. Aug 17 16:30:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-129dc3e7-3c90-4474-ab46-8433f216d352 tempest-ProjectReaderTests-930609166 None] Lock "cinder-cd053b60-3abf-40c1-9c4a-b87f6e3fc804-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Creating offline snapshot 977f6141-164d-4259-b9e2-290d896810c8 of volume 6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6424502-d0b8-4fc8-bb26-835b6c277882]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:43 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:43 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:43 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:43 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 1G Aug 17 16:30:43 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:44 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 1G" returned: 0 in 0.690s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:44 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:44 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:45 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 is being set with open permissions: ugo+rw Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:45 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:45 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:45 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.437s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:45 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info Aug 17 16:30:45 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:45 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info is being set with open permissions: ugo+rw Aug 17 16:30:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:46 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info Aug 17 16:30:46 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:46 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.info" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-96dc48dd-29f9-4993-83a8-280619f10267 tempest-VolumesDeleteCascade-209066889 None] Create snapshot completed successfully Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:46 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:46 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Creating offline snapshot ca953a8e-dfe4-4222-a704-f1eacfd56ada of volume 6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf472bf-8156-4654-8ee3-8c5d78b88b74]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:47 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:47 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:47 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.487s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:30:47 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.554s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6860b158-260f-44d2-ad6c-87810686c076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:30:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:47 devstack sudo[109950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada 1G Aug 17 16:30:47 devstack sudo[109950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:48 devstack sudo[109950]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada 1G" returned: 0 in 0.689s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:48 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:48 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:48 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:48 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada is being set with open permissions: ugo+rw Aug 17 16:30:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:48 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:48 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:49 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-28de54d9-7e0e-4461-b684-ffe1c8192750 tempest-VolumesDeleteCascade-209066889 None] Create snapshot completed successfully Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-6860b158-260f-44d2-ad6c-87810686c076-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-6860b158-260f-44d2-ad6c-87810686c076-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=91,cinder:UPDATE=147,cinder:INSERT=30,cinder:DELETE=11 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Performing cascade delete. {{(pid=94468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-977f6141-164d-4259-b9e2-290d896810c8-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-977f6141-164d-4259-b9e2-290d896810c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-977f6141-164d-4259-b9e2-290d896810c8" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-977f6141-164d-4259-b9e2-290d896810c8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Deleting offline snapshot 977f6141-164d-4259-b9e2-290d896810c8 of volume 6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] snapshot_file for this snap is: volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c72b848-9b9e-4104-bc0e-8d333d5596cb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:50 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:50 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:51 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.532s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6860b158-260f-44d2-ad6c-87810686c076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5036d-7e63-427d-a087-22f7767809fe]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:51 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:51 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:51 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.683s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f76a6f-c395-4569-aa1d-3c20f0b815dd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:52 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:52 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:52 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.628s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6860b158-260f-44d2-ad6c-87810686c076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efe858-e8ff-4716-9ffc-2c55bb558c01]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:52 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:52 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:52 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6860b158-260f-44d2-ad6c-87810686c076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe42c7-7197-469c-813e-76b8dc74634c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:53 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:53 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:53 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.470s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:53 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:53 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:53 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.466s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:54 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8 Aug 17 16:30:54 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:54 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.977f6141-164d-4259-b9e2-290d896810c8" returned: 0 in 0.336s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada -F qcow2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:54 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada -F qcow2 Aug 17 16:30:54 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:54 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6860b158-260f-44d2-ad6c-87810686c076 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada -F qcow2" returned: 0 in 0.420s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-977f6141-164d-4259-b9e2-290d896810c8" released by "_delete_snapshot" :: held 4.281s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" released by "delete_snapshot" :: held 4.317s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Created reservations ['e4ce3340-305b-4992-8c46-b459c6753dbc', '1fe66739-118d-4f12-b326-6b922d041212', 'e1bf102c-f608-43b2-93e1-c4c4f462db8c', '2125cffe-53d6-4a75-8f82-cef8f9388589'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Delete snapshot completed successfully. Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-977f6141-164d-4259-b9e2-290d896810c8-delete_snapshot" released by "delete_snapshot" :: held 4.529s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-ca953a8e-dfe4-4222-a704-f1eacfd56ada-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-ca953a8e-dfe4-4222-a704-f1eacfd56ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-ca953a8e-dfe4-4222-a704-f1eacfd56ada" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-ca953a8e-dfe4-4222-a704-f1eacfd56ada" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Deleting offline snapshot ca953a8e-dfe4-4222-a704-f1eacfd56ada of volume 6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] snapshot_file for this snap is: volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[40311bc1-5374-4d7a-b6fc-ce4e06b9f254]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:55 devstack sudo[110009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:55 devstack sudo[110009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:55 devstack sudo[110009]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.554s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6860b158-260f-44d2-ad6c-87810686c076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87e00e-fb2a-436b-b303-a9a64c6590e9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:55 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:55 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:56 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.508s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:56 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:56 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:56 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.496s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:56 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada Aug 17 16:30:56 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:57 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076.ca953a8e-dfe4-4222-a704-f1eacfd56ada" returned: 0 in 0.356s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-ca953a8e-dfe4-4222-a704-f1eacfd56ada" released by "_delete_snapshot" :: held 2.082s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" released by "delete_snapshot" :: held 2.112s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Created reservations ['d70c025a-f1f7-485a-b19c-6ad08121ccf1', 'a3f8457f-6ba1-4c77-a6dd-928a58bda863', '840ed6b5-6bf8-4225-b61a-1b0874cbff48', '75098bf9-edff-44b3-8ef1-44a5aa3c9689'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Delete snapshot completed successfully. Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-ca953a8e-dfe4-4222-a704-f1eacfd56ada-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Snapshots deleted, issuing volume delete {{(pid=94468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8feb9-cc48-48ff-b244-d24dd7a4b0bc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:57 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:57 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:57 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.453s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:57 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076 Aug 17 16:30:57 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:58 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6860b158-260f-44d2-ad6c-87810686c076" returned: 0 in 0.334s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-6860b158-260f-44d2-ad6c-87810686c076" released by "delete_volume" :: held 0.867s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Created reservations ['3e351e9d-d309-4a89-83f4-4d38a9695e3e', '170a802b-2fcf-4997-9224-a6256c6320db', '0199f4be-0120-4319-9bf4-b8a3ee5cd40f', 'b3ce85e7-12cc-440c-ab45-8c589ced50df'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:30:58 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:30:58 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:30:58 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.320s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:30:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Deleted volume successfully. Aug 17 16:30:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-769e52e5-4fe8-4d0e-aa94-b7ea9277156b tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-6860b158-260f-44d2-ad6c-87810686c076-delete_volume" released by "delete_volume" :: held 8.476s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:30:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:30:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (bf26c300-1ded-4c86-87ea-645728565cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:30:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb1825e-1c88-4b32-b451-51827bdb1060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:30:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb1825e-1c88-4b32-b451-51827bdb1060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935227088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19b1faf-62fe-40ee-82b4-235e9aefb629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3732b2f2254ff4bb192a4bdb3c3a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:00Z,use_quota=True,user_id='6a165d44439245d08b3d2386e883dcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32544bcd-16bf-4406-bb91-10ca788f5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32544bcd-16bf-4406-bb91-10ca788f5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9699d9ac-eff2-46d4-999f-b44c92435d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9699d9ac-eff2-46d4-999f-b44c92435d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19b1faf-62fe-40ee-82b4-235e9aefb629', 'volume_name': 'volume-e19b1faf-62fe-40ee-82b4-235e9aefb629', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6e2d5b-b322-4db6-a933-b056658639e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6e2d5b-b322-4db6-a933-b056658639e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bdabe9-d46d-4a4f-ab6a-69b758f05754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Volume e19b1faf-62fe-40ee-82b4-235e9aefb629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19b1faf-62fe-40ee-82b4-235e9aefb629', 'volume_size': 1} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935227088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19b1faf-62fe-40ee-82b4-235e9aefb629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3732b2f2254ff4bb192a4bdb3c3a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:00Z,use_quota=True,user_id='6a165d44439245d08b3d2386e883dcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Creating volume e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:00 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:00 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 1073741824 Aug 17 16:31:00 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:00 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 1073741824" returned: 0 in 0.627s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:00 devstack sudo[110047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:00 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:01 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.444s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9bdabe9-d46d-4a4f-ab6a-69b758f05754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19b1faf-62fe-40ee-82b4-235e9aefb629', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59652f2b-6424-4ac9-a712-206cf175f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:01 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Volume volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 (e19b1faf-62fe-40ee-82b4-235e9aefb629): created successfully Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59652f2b-6424-4ac9-a712-206cf175f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (bf26c300-1ded-4c86-87ea-645728565cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c603d04e-c9eb-41f8-a64c-e7e38b23ec72 tempest-VolumesDeleteCascade-209066889 None] Created volume successfully. Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Creating offline snapshot 3a2c4c96-27b6-4823-89ed-24d2d86776dd of volume e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f160c3-ca4a-450e-8a0e-9e93b00c89cf]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:02 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:02 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:02 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:02 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd 1G Aug 17 16:31:02 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:03 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd 1G" returned: 0 in 0.599s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:03 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:03 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:03 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:03 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd is being set with open permissions: ugo+rw Aug 17 16:31:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:03 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:03 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:04 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.312s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:04 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info Aug 17 16:31:04 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Flow 'volume_create_manager' (999cb44e-f5cb-4062-875a-e4e0d23f431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c13e0dd-44bd-465f-aa9a-f7b07a649fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c13e0dd-44bd-465f-aa9a-f7b07a649fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1286614714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a8806-931b-44fa-aa43-e3cd34d74a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c02359418a429bbd94fd5ebdf71aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:04Z,use_quota=True,user_id='2474d4e0c6d048f3b2fa94924926e4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eccab32-e76f-458d-b8bf-e420bec1c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eccab32-e76f-458d-b8bf-e420bec1c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdac6e7-6832-41b0-901c-39266a61ca8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdac6e7-6832-41b0-901c-39266a61ca8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209a8806-931b-44fa-aa43-e3cd34d74a36', 'volume_name': 'volume-209a8806-931b-44fa-aa43-e3cd34d74a36', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a69d6c8-13be-4c82-a550-470ddc133b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a69d6c8-13be-4c82-a550-470ddc133b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f17d01-7e0a-49d1-bac0-c5c954d2b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Volume 209a8806-931b-44fa-aa43-e3cd34d74a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209a8806-931b-44fa-aa43-e3cd34d74a36', 'volume_size': 1} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:04 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:04 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info is being set with open permissions: ugo+rw Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:04 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info Aug 17 16:31:04 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:04 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.info" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1286614714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a8806-931b-44fa-aa43-e3cd34d74a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c02359418a429bbd94fd5ebdf71aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:04Z,use_quota=True,user_id='2474d4e0c6d048f3b2fa94924926e4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Creating volume 209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:04 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:04 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=151,cinder:SELECT=125,cinder:DELETE=14,cinder:INSERT=36 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:31:04 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 1073741824 Aug 17 16:31:04 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-51ef1de0-682b-47d7-9889-a62f5a3c36f8 tempest-VolumesDeleteCascade-209066889 None] Create snapshot completed successfully Aug 17 16:31:05 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 1073741824" returned: 0 in 0.644s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:05 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:31:05 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:05 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.450s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f17d01-7e0a-49d1-bac0-c5c954d2b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209a8806-931b-44fa-aa43-e3cd34d74a36', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:05 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b78c3-865f-4397-8fa1-4cc9fb7943b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Volume volume-209a8806-931b-44fa-aa43-e3cd34d74a36 (209a8806-931b-44fa-aa43-e3cd34d74a36): created successfully Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487b78c3-865f-4397-8fa1-4cc9fb7943b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Flow 'volume_create_manager' (999cb44e-f5cb-4062-875a-e4e0d23f431e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8d496c0c-add8-4645-a3f2-7c47789f2821 tempest-TestStampPattern-1769570272 None] Created volume successfully. Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (2ae401ad-0327-42c5-8810-5132907527b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63b82bc-02a7-4902-9d2c-cd2132e90de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d63b82bc-02a7-4902-9d2c-cd2132e90de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1158806697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3732b2f2254ff4bb192a4bdb3c3a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a2c4c96-27b6-4823-89ed-24d2d86776dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:06Z,use_quota=True,user_id='6a165d44439245d08b3d2386e883dcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024d0bb4-0113-4afa-bdd9-3ac9aa84644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024d0bb4-0113-4afa-bdd9-3ac9aa84644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626858a5-b768-4bf8-b5e2-4db0688c4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (626858a5-b768-4bf8-b5e2-4db0688c4f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb', 'volume_name': 'volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb', 'volume_size': 1, 'snapshot_id': '3a2c4c96-27b6-4823-89ed-24d2d86776dd'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d851c46-735e-494a-adcb-8e566fcdb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d851c46-735e-494a-adcb-8e566fcdb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c242f6a-8676-472b-bd0b-2b9cb544f9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:06 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Volume 41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb', 'volume_size': 1, 'snapshot_id': '3a2c4c96-27b6-4823-89ed-24d2d86776dd'} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Creating volume 41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb from snapshot 3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] snapshot: 3a2c4c96-27b6-4823-89ed-24d2d86776dd, volume: 41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b125f-e8a0-4601-b3eb-91bd2164c145]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:06 devstack sudo[110089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:06 devstack sudo[110089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:07 devstack sudo[110089]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.641s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19b1faf-62fe-40ee-82b4-235e9aefb629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8289394c-609e-4df9-bb9f-63941602d60a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:07 devstack sudo[110095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:07 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:07 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.525s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:31:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:07 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb Aug 17 16:31:07 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:13 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" returned: 0 in 5.850s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:13 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:31:13 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Converted 1024.00 MB image at 175.02 MB/s Aug 17 16:31:13 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb is being set with open permissions: ugo+rw Aug 17 16:31:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:13 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb Aug 17 16:31:13 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:14 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" returned: 0 in 0.313s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" released by "_copy_volume_from_snapshot" :: held 7.483s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" released by "_create_volume_from_snapshot" :: held 7.575s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.607s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c242f6a-8676-472b-bd0b-2b9cb544f9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb', 'volume_size': 1, 'snapshot_id': '3a2c4c96-27b6-4823-89ed-24d2d86776dd'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0417060-9c77-4f7d-b2a1-7191fcc03aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:14 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Volume volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb (41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb): created successfully Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0417060-9c77-4f7d-b2a1-7191fcc03aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:14 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Flow 'volume_create_manager' (2ae401ad-0327-42c5-8810-5132907527b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:14 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1880f03b-c47a-4228-8f55-7ba6453c555f tempest-VolumesDeleteCascade-209066889 None] Created volume successfully. Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-e19b1faf-62fe-40ee-82b4-235e9aefb629-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-e19b1faf-62fe-40ee-82b4-235e9aefb629-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Flow 'volume_create_manager' (7e932484-f299-4979-8f06-950680a9c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a021e43-5fac-4005-8fe0-bd2735a2eee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Performing cascade delete. {{(pid=94468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a021e43-5fac-4005-8fe0-bd2735a2eee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-46440379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b5eab-0d66-4ed7-8408-5e63c3127200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6c247e673546a5afae32771b142c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:15Z,use_quota=True,user_id='e97c8bc31076485e82d02bed256df1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782df748-3178-4568-a16b-f5cd643770b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782df748-3178-4568-a16b-f5cd643770b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac72499-0332-490c-b567-31ace1158d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-3a2c4c96-27b6-4823-89ed-24d2d86776dd-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-3a2c4c96-27b6-4823-89ed-24d2d86776dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Deleting offline snapshot 3a2c4c96-27b6-4823-89ed-24d2d86776dd of volume e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] snapshot_file for this snap is: volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5086ba6-7f25-41d9-b240-bc3261196b45]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:16 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:16 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac72499-0332-490c-b567-31ace1158d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '753b5eab-0d66-4ed7-8408-5e63c3127200', 'volume_name': 'volume-753b5eab-0d66-4ed7-8408-5e63c3127200', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1906537-4a5c-42b4-a7fe-3644f2bffc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1906537-4a5c-42b4-a7fe-3644f2bffc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c756b9-41cc-4aa2-b3b8-e1ea5efe5378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:16 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Volume 753b5eab-0d66-4ed7-8408-5e63c3127200: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-753b5eab-0d66-4ed7-8408-5e63c3127200', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Trying to clone 753b5eab-0d66-4ed7-8408-5e63c3127200 from image 9d40602e-5637-4537-aeab-5c295ac7c705 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:31:16 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.477s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19b1faf-62fe-40ee-82b4-235e9aefb629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[93952994-e30d-490e-a7e8-95137dd1a6f4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:31:16 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Image download 20.69 MB at 20.69 MB/s Aug 17 16:31:16 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:16 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[22994e72-9420-430c-954a-f3414640f115]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:16 devstack sudo[110224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD Aug 17 16:31:16 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:17 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:17 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 is fetched for user e97c8bc31076485e82d02bed256df1bb. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.698s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:17 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:17 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[73806674-9bc7-4d80-b4b9-82783faa915e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:17 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD Aug 17 16:31:17 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:17 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.535s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:17 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd Aug 17 16:31:17 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:17 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD" returned: 0 in 0.516s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-46440379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b5eab-0d66-4ed7-8408-5e63c3127200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6c247e673546a5afae32771b142c4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:15Z,use_quota=True,user_id='e97c8bc31076485e82d02bed256df1bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Creating volume 753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:17 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:17 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1073741824 Aug 17 16:31:17 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:18 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629.3a2c4c96-27b6-4823-89ed-24d2d86776dd" returned: 0 in 0.334s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-3a2c4c96-27b6-4823-89ed-24d2d86776dd" released by "_delete_snapshot" :: held 2.201s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" released by "delete_snapshot" :: held 2.231s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Created reservations ['d9e2a3bb-53b5-4949-a568-227acd359022', '9d15aeeb-b94c-48a9-af0d-a1c7d9e542bd', '444b5913-e943-43d1-9298-594facd96ce7', 'abfb10a9-4b01-4611-bcca-99673f368fef'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Delete snapshot completed successfully. Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-3a2c4c96-27b6-4823-89ed-24d2d86776dd-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Snapshots deleted, issuing volume delete {{(pid=94468) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca0f138-b5a5-43b4-bcef-a99fb2a02e9a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:18 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1073741824" returned: 0 in 0.686s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:18 devstack sudo[110253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:18 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:18 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 Aug 17 16:31:18 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:18 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:18 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200" returned: 0 in 0.339s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:18 devstack sudo[110261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629 Aug 17 16:31:18 devstack sudo[110261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:18 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Attempting download of 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume 753b5eab-0d66-4ed7-8408-5e63c3127200. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1317f78-db6b-4d93-9d45-fd5b1d27946e]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:19 devstack sudo[110261]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e19b1faf-62fe-40ee-82b4-235e9aefb629" returned: 0 in 0.342s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:19 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya Aug 17 16:31:19 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-e19b1faf-62fe-40ee-82b4-235e9aefb629" released by "delete_volume" :: held 0.940s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Created reservations ['fedf066f-a96f-44fd-a4b7-5e82a31eeb7a', '5a6b1d5d-d03d-4000-9368-3fc37b65a658', 'cbda190f-b982-478b-928f-d76b11d82e3c', 'e3ba97dd-98a2-4bb6-b532-082c1ed0a095'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:19 devstack sudo[110266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:31:19 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:19 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya" returned: 0 in 0.654s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:19 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.383s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:31:19 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya Aug 17 16:31:19 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Deleted volume successfully. Aug 17 16:31:19 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-178a4548-266c-414d-a989-6762eeeb89a2 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-e19b1faf-62fe-40ee-82b4-235e9aefb629-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:20 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya" returned: 1 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d40602e-5637-4537-aeab-5c295ac7c705_wlxs1hya' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6e64d8-4f11-487c-afdb-726b2f43bf4d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:20 devstack sudo[110275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD Aug 17 16:31:20 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c227dab-9d7d-4b19-a4d2-5cb3386ed0ea]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:20 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] 9d40602e-5637-4537-aeab-5c295ac7c705 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:31:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:20 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb Aug 17 16:31:20 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:20 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 Aug 17 16:31:20 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:21 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" returned: 0 in 0.477s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:21 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb Aug 17 16:31:21 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:21 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" returned: 0 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-quobyte-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb" released by "delete_volume" :: held 0.896s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Created reservations ['6bebbf92-f833-433a-8542-97774b2f5c32', '4fd011f3-730f-4189-92b0-c86791dd627b', '9623faec-01ba-4431-9125-bf11d714e009', '4fd3a72b-74f6-4113-b553-df18668c6fe1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:21 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:31:21 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:22 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.499s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:22 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:31:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Deleted volume successfully. Aug 17 16:31:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6693708-7906-4b46-9e87-8d34605c3cb1 tempest-VolumesDeleteCascade-209066889 None] Lock "cinder-41c989f1-c5f1-4d59-b09d-dad8c2dbf7bb-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:23 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200" returned: 0 in 2.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d40602e-5637-4537-aeab-5c295ac7c705_u2n_hzwhdevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:31:23 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Converted 112.00 MB image at 46.75 MB/s Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:23 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1G Aug 17 16:31:23 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:23 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 1G" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Downloaded image 9d40602e-5637-4537-aeab-5c295ac7c705 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}])) to volume 753b5eab-0d66-4ed7-8408-5e63c3127200 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Temporary image 9d40602e-5637-4537-aeab-5c295ac7c705 for user e97c8bc31076485e82d02bed256df1bb is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Marking volume 753b5eab-0d66-4ed7-8408-5e63c3127200 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Copying metadata from image 9d40602e-5637-4537-aeab-5c295ac7c705 to 753b5eab-0d66-4ed7-8408-5e63c3127200. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Creating volume glance metadata for volume 753b5eab-0d66-4ed7-8408-5e63c3127200 backed by image 9d40602e-5637-4537-aeab-5c295ac7c705 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c756b9-41cc-4aa2-b3b8-e1ea5efe5378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753b5eab-0d66-4ed7-8408-5e63c3127200', 'volume_size': 1, 'image_id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d40602e-5637-4537-aeab-5c295ac7c705', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3baed8c5e4d740b5a0a512e6c01562d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9d40602e-5637-4537-aeab-5c295ac7c705', 'created_at': datetime.datetime(2026, 8, 17, 14, 9, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 9, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d40602e-5637-4537-aeab-5c295ac7c705/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6932e8-2439-41f9-a79f-f23e588e5ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Volume volume-753b5eab-0d66-4ed7-8408-5e63c3127200 (753b5eab-0d66-4ed7-8408-5e63c3127200): created successfully Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6932e8-2439-41f9-a79f-f23e588e5ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Flow 'volume_create_manager' (7e932484-f299-4979-8f06-950680a9c694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bcab28db-ffff-4b2b-b885-800422e9a805 tempest-TestShelveInstance-135885357 None] Created volume successfully. Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-8e35f140-c670-49e3-87c7-81919853a46a req-1bf0475d-c0bb-4b1d-ac59-3493701091be tempest-TestShelveInstance-135885357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-8e35f140-c670-49e3-87c7-81919853a46a req-1bf0475d-c0bb-4b1d-ac59-3493701091be tempest-TestShelveInstance-135885357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Flow 'volume_create_manager' (207d2243-63ee-409b-8a3a-f96c5e3dc046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8853e139-1ae5-428d-9a44-660c43ea1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8853e139-1ae5-428d-9a44-660c43ea1698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1046597422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b1b66-8a59-4518-96e2-c033c99fe3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c47a3a551e4a0ba06a307be758fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:27Z,use_quota=True,user_id='c6fb021169a04b5b8a7171f00079d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f905504-80c9-494d-b4b6-b9bfb3799d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f905504-80c9-494d-b4b6-b9bfb3799d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04fb42-48ac-44dd-93a1-af47565da09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da04fb42-48ac-44dd-93a1-af47565da09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '108b1b66-8a59-4518-96e2-c033c99fe3ee', 'volume_name': 'volume-108b1b66-8a59-4518-96e2-c033c99fe3ee', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b53bd2-a300-4c26-85e7-394b96bd4cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b53bd2-a300-4c26-85e7-394b96bd4cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9936ae56-d535-4ada-8beb-ac6b2cfc9f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Volume 108b1b66-8a59-4518-96e2-c033c99fe3ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-108b1b66-8a59-4518-96e2-c033c99fe3ee', 'volume_size': 1} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-8e35f140-c670-49e3-87c7-81919853a46a req-1bf0475d-c0bb-4b1d-ac59-3493701091be tempest-TestShelveInstance-135885357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.112s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1046597422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=108b1b66-8a59-4518-96e2-c033c99fe3ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c47a3a551e4a0ba06a307be758fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:27Z,use_quota=True,user_id='c6fb021169a04b5b8a7171f00079d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Creating volume 108b1b66-8a59-4518-96e2-c033c99fe3ee {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:27 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee 1073741824 Aug 17 16:31:27 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-8e35f140-c670-49e3-87c7-81919853a46a req-1bf0475d-c0bb-4b1d-ac59-3493701091be tempest-TestShelveInstance-135885357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-753b5eab-0d66-4ed7-8408-5e63c3127200', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9540ffd3-e387-465c-91cb-aec6cb3ab686', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:31:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-8e35f140-c670-49e3-87c7-81919853a46a req-1bf0475d-c0bb-4b1d-ac59-3493701091be tempest-TestShelveInstance-135885357 None] attachment_update completed successfully. Aug 17 16:31:28 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee 1073741824" returned: 0 in 0.724s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:28 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee Aug 17 16:31:28 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:28 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee" returned: 0 in 0.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9936ae56-d535-4ada-8beb-ac6b2cfc9f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-108b1b66-8a59-4518-96e2-c033c99fe3ee', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d665e7-a82d-41e5-8cd3-091a0a0b134c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Volume volume-108b1b66-8a59-4518-96e2-c033c99fe3ee (108b1b66-8a59-4518-96e2-c033c99fe3ee): created successfully Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d665e7-a82d-41e5-8cd3-091a0a0b134c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Flow 'volume_create_manager' (207d2243-63ee-409b-8a3a-f96c5e3dc046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-683ad7a4-c001-4598-acd2-44a7bc174729 tempest-VolumesTransfersTest-1491575889 None] Created volume successfully. Aug 17 16:31:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb020aa8-21a9-4a5d-a74b-656179104bcc tempest-VolumesTransfersTest-242858823 None] Transfer volume completed successfully. Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "cinder-108b1b66-8a59-4518-96e2-c033c99fe3ee-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-108b1b66-8a59-4518-96e2-c033c99fe3ee-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "cinder-quobyte-108b1b66-8a59-4518-96e2-c033c99fe3ee" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-quobyte-108b1b66-8a59-4518-96e2-c033c99fe3ee" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[973fdcec-049c-4138-a5c6-d973c9b344a9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:32 devstack sudo[110841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee Aug 17 16:31:32 devstack sudo[110841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:32 devstack sudo[110841]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee" returned: 0 in 0.417s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:32 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee Aug 17 16:31:32 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:32 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-108b1b66-8a59-4518-96e2-c033c99fe3ee" returned: 0 in 0.296s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-quobyte-108b1b66-8a59-4518-96e2-c033c99fe3ee" released by "delete_volume" :: held 0.817s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Created reservations ['bec7f4d0-d04a-474f-ae9f-f2a1eeb4df83', '49a8942d-80af-459a-afe6-bdf9f3773925', '1b4f72c9-365b-4dde-affd-1b29dcb82a54', '46c992f7-70a3-434c-8536-84035e0969c0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:32 devstack sudo[110875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:31:32 devstack sudo[110875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:33 devstack sudo[110875]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.260s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:31:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Deleted volume successfully. Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-92cd4283-e6cd-4f28-99e4-2ddf9ea4ff76 tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-108b1b66-8a59-4518-96e2-c033c99fe3ee-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Flow 'volume_create_manager' (3247bfce-8b2c-48c9-8776-f97872616e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2a454a-b687-4f61-a042-fabfde68f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2a454a-b687-4f61-a042-fabfde68f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-621180989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56c003-db85-46f3-afac-d76904d1587a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c47a3a551e4a0ba06a307be758fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:34Z,use_quota=True,user_id='c6fb021169a04b5b8a7171f00079d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd5d7e1-29c6-4593-b332-1b55dd984e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edd5d7e1-29c6-4593-b332-1b55dd984e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6cb36e-b8a4-4471-af80-2789d4b6e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb6cb36e-b8a4-4471-af80-2789d4b6e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc56c003-db85-46f3-afac-d76904d1587a', 'volume_name': 'volume-cc56c003-db85-46f3-afac-d76904d1587a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea541a1-29cc-483e-b9c2-2f6206949be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea541a1-29cc-483e-b9c2-2f6206949be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff33236-cfbe-47f1-917a-d505ac2fd6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Volume cc56c003-db85-46f3-afac-d76904d1587a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc56c003-db85-46f3-afac-d76904d1587a', 'volume_size': 1} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-621180989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc56c003-db85-46f3-afac-d76904d1587a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c47a3a551e4a0ba06a307be758fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:34Z,use_quota=True,user_id='c6fb021169a04b5b8a7171f00079d1f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Creating volume cc56c003-db85-46f3-afac-d76904d1587a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:33 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a 1073741824 Aug 17 16:31:33 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:34 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a 1073741824" returned: 0 in 0.500s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:34 devstack sudo[110886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a Aug 17 16:31:34 devstack sudo[110886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:34 devstack sudo[110886]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff33236-cfbe-47f1-917a-d505ac2fd6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc56c003-db85-46f3-afac-d76904d1587a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745bcc15-73a1-4b36-96b0-ed74c75e8a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Volume volume-cc56c003-db85-46f3-afac-d76904d1587a (cc56c003-db85-46f3-afac-d76904d1587a): created successfully Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745bcc15-73a1-4b36-96b0-ed74c75e8a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Flow 'volume_create_manager' (3247bfce-8b2c-48c9-8776-f97872616e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f4933a6b-f0a7-4635-b15e-18e2b242cd03 tempest-VolumesTransfersTest-1491575889 None] Created volume successfully. Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "cinder-cc56c003-db85-46f3-afac-d76904d1587a-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-cc56c003-db85-46f3-afac-d76904d1587a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "cinder-quobyte-cc56c003-db85-46f3-afac-d76904d1587a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-quobyte-cc56c003-db85-46f3-afac-d76904d1587a" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5e7e97-2cf1-4074-9cc8-e8c8698a2a5f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:36 devstack sudo[110889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a Aug 17 16:31:36 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:36 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a" returned: 0 in 0.478s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:36 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a Aug 17 16:31:36 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:37 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-cc56c003-db85-46f3-afac-d76904d1587a" returned: 0 in 0.274s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-quobyte-cc56c003-db85-46f3-afac-d76904d1587a" released by "delete_volume" :: held 0.809s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Created reservations ['47219c29-8ff5-42be-af06-a8b6e575d94f', '0af9988b-29f0-40c8-8782-d1fc5fb41221', '039e7180-0771-4cf3-9a8c-cc566a041ccd', '7b2ae51f-8456-4e40-bb55-8f160a240d86'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:37 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:31:37 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:37 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.525s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:31:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Deleted volume successfully. Aug 17 16:31:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebf5e13-00b4-45ea-bc23-50cf2230bffa tempest-VolumesTransfersTest-1257113647 None] Lock "cinder-cc56c003-db85-46f3-afac-d76904d1587a-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-159d7ca3-93ee-4454-ada8-1634e3f029e4 req-fbe2e29d-2f27-4045-ac95-407738442600 tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-159d7ca3-93ee-4454-ada8-1634e3f029e4 req-fbe2e29d-2f27-4045-ac95-407738442600 tempest-TestStampPattern-1769570272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-159d7ca3-93ee-4454-ada8-1634e3f029e4 req-fbe2e29d-2f27-4045-ac95-407738442600 tempest-TestStampPattern-1769570272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-159d7ca3-93ee-4454-ada8-1634e3f029e4 req-fbe2e29d-2f27-4045-ac95-407738442600 tempest-TestStampPattern-1769570272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-209a8806-931b-44fa-aa43-e3cd34d74a36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '010d5071-68ea-40ae-a69d-509d3749459a', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:31:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-159d7ca3-93ee-4454-ada8-1634e3f029e4 req-fbe2e29d-2f27-4045-ac95-407738442600 tempest-TestStampPattern-1769570272 None] attachment_update completed successfully. Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Flow 'volume_create_manager' (d1bdada9-e005-4a73-999d-86c85e12c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e44eb0-48af-48cd-a95f-71d918721ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e44eb0-48af-48cd-a95f-71d918721ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1880853268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5490632b-2727-4903-b535-34772db75f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aba4f62119d459c9661dfd816ef7baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:44Z,use_quota=True,user_id='7bf4bee171b44026918a5242df633335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d9f11-cf96-4070-8bbb-c2ff586a57cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6d9f11-cf96-4070-8bbb-c2ff586a57cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a720f73a-4328-4f2e-a4e5-e3439ec694fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a720f73a-4328-4f2e-a4e5-e3439ec694fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5490632b-2727-4903-b535-34772db75f93', 'volume_name': 'volume-5490632b-2727-4903-b535-34772db75f93', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a506c68a-ba45-4951-adfa-a585efa3b554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a506c68a-ba45-4951-adfa-a585efa3b554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6692488-c39d-48c6-9583-e575d695e447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:44 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Volume 5490632b-2727-4903-b535-34772db75f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5490632b-2727-4903-b535-34772db75f93', 'volume_size': 1} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1880853268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5490632b-2727-4903-b535-34772db75f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3aba4f62119d459c9661dfd816ef7baf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:31:44Z,use_quota=True,user_id='7bf4bee171b44026918a5242df633335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Creating volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:31:44 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:44 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 1073741824 Aug 17 16:31:44 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:44 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 1073741824" returned: 0 in 0.473s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:44 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 Aug 17 16:31:44 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:44 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6692488-c39d-48c6-9583-e575d695e447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5490632b-2727-4903-b535-34772db75f93', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1ef2b-4e01-4d82-a6b0-5a9e55addf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:31:44 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Volume volume-5490632b-2727-4903-b535-34772db75f93 (5490632b-2727-4903-b535-34772db75f93): created successfully Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad1ef2b-4e01-4d82-a6b0-5a9e55addf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:31:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Flow 'volume_create_manager' (d1bdada9-e005-4a73-999d-86c85e12c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:31:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-159ef0be-06c2-4d8c-b34c-dd38b7318aec tempest-VolumesSnapshotListTestJSON-1670095085 None] Created volume successfully. Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Creating offline snapshot e57d1965-b23c-4dd0-9335-2d0890b592f8 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d865d-2a51-42bc-a846-aecf549d8403]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:46 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 Aug 17 16:31:46 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:46 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93" returned: 0 in 0.414s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:46 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 1G Aug 17 16:31:46 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:46 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:31:46 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:47 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.286s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:31:47 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 1G" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:47 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:31:47 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:47 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:47 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 is being set with open permissions: ugo+rw Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:47 devstack sudo[110974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:31:47 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:47 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.301s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:48 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info Aug 17 16:31:48 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-3eacdb6e-f3a2-463f-a2b9-603c576f8000 req-9200aacd-0fde-4ab0-a51d-99b5c00b9fea tempest-TestStampPattern-1769570272 None] Terminate volume connection completed successfully. Aug 17 16:31:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-3eacdb6e-f3a2-463f-a2b9-603c576f8000 req-9200aacd-0fde-4ab0-a51d-99b5c00b9fea tempest-TestStampPattern-1769570272 None] Deleting attachment 010d5071-68ea-40ae-a69d-509d3749459a. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:31:48 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info" returned: 0 in 0.299s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:48 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info is being set with open permissions: ugo+rw Aug 17 16:31:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:48 devstack sudo[110986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info Aug 17 16:31:48 devstack sudo[110986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:48 devstack sudo[110986]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.info" returned: 0 in 0.275s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2661561b-3d12-4547-974b-fc14e55d76bd tempest-VolumesSnapshotListTestJSON-1670095085 None] Create snapshot completed successfully Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Creating offline snapshot 1288b666-8f30-4599-a854-bb0e858efea6 of volume 209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a702f6a2-e655-4c87-bb4e-dd9ddf30fe52]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:49 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:31:49 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:49 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.468s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:49 devstack sudo[110996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 1G Aug 17 16:31:49 devstack sudo[110996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:50 devstack sudo[110996]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 1G" returned: 0 in 0.543s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209a8806-931b-44fa-aa43-e3cd34d74a36 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:50 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209a8806-931b-44fa-aa43-e3cd34d74a36 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:31:50 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:50 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-209a8806-931b-44fa-aa43-e3cd34d74a36 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.328s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:50 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 is being set with open permissions: ugo+rw Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:50 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:31:50 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:50 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.259s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=81,cinder:DELETE=8 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:50 devstack sudo[111046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info Aug 17 16:31:50 devstack sudo[111046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:50 devstack sudo[111046]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:50 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info is being set with open permissions: ugo+rw Aug 17 16:31:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:50 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info Aug 17 16:31:50 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:51 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.info" returned: 0 in 0.261s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.560s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Creating offline snapshot 3ffad3fa-2a8d-4f00-b5ae-a4796531b097 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17393955-cb9d-4a2e-b6d8-c8e40a2cd73e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2c17e5bf-b876-4a39-ae3d-9cd45f769f51 tempest-TestStampPattern-1769570272 None] Create snapshot completed successfully Aug 17 16:31:51 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:31:51 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:51 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:51 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 1G Aug 17 16:31:51 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:52 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 1G" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:52 devstack sudo[111071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:31:52 devstack sudo[111071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:52 devstack sudo[111071]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.319s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:52 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 is being set with open permissions: ugo+rw Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:52 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:31:52 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:52 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.585s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:52 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-77f3c979-86c0-45aa-938a-dc62a0e353f2 tempest-VolumesSnapshotListTestJSON-1670095085 None] Create snapshot completed successfully Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Creating offline snapshot 14faea9e-adc3-4a56-b1d3-c44ba2610904 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87ca9f6-4d7d-4f09-b310-4b5645c91014]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:54 devstack sudo[111099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:31:54 devstack sudo[111099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:54 devstack sudo[111099]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.437s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:54 devstack sudo[111108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 1G Aug 17 16:31:54 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:55 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 1G" returned: 0 in 0.518s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:55 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 Aug 17 16:31:55 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:55 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:55 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 is being set with open permissions: ugo+rw Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:55 devstack sudo[111129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 Aug 17 16:31:55 devstack sudo[111129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:55 devstack sudo[111129]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.689s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:31:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7a6621fa-6118-4250-909c-5a3e5aa86aeb tempest-VolumesSnapshotListTestJSON-1670095085 None] Create snapshot completed successfully Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-14faea9e-adc3-4a56-b1d3-c44ba2610904-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-14faea9e-adc3-4a56-b1d3-c44ba2610904-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-14faea9e-adc3-4a56-b1d3-c44ba2610904" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-14faea9e-adc3-4a56-b1d3-c44ba2610904" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Deleting offline snapshot 14faea9e-adc3-4a56-b1d3-c44ba2610904 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] snapshot_file for this snap is: volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7981e5f-facf-44ce-a19d-9ca21b6e06d4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:57 devstack sudo[111132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 Aug 17 16:31:57 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:57 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904" returned: 0 in 0.456s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f8a4e-c184-455c-9f98-314ca0608bfa]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:57 devstack sudo[111137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:31:57 devstack sudo[111137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:58 devstack sudo[111137]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.411s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:58 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 Aug 17 16:31:58 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:58 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904" returned: 0 in 0.484s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:58 devstack sudo[111148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904 Aug 17 16:31:58 devstack sudo[111148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:58 devstack sudo[111148]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.14faea9e-adc3-4a56-b1d3-c44ba2610904" returned: 0 in 0.304s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-14faea9e-adc3-4a56-b1d3-c44ba2610904" released by "_delete_snapshot" :: held 1.797s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" released by "delete_snapshot" :: held 1.823s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:58 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Created reservations ['fca68eab-45e6-4a0f-b129-f59452b5fe28', 'fa75131e-42cc-48da-95dc-9e8395db935b', '936404b1-3055-421e-9e94-9392ac6e1ccf', '37e8d586-6d84-4759-a012-5e37ab5c4c68'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:31:59 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Delete snapshot completed successfully. Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c3acc488-5081-4ffd-b1d6-23f6e99cb77c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-14faea9e-adc3-4a56-b1d3-c44ba2610904-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-3ffad3fa-2a8d-4f00-b5ae-a4796531b097-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-3ffad3fa-2a8d-4f00-b5ae-a4796531b097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-3ffad3fa-2a8d-4f00-b5ae-a4796531b097" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-3ffad3fa-2a8d-4f00-b5ae-a4796531b097" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Deleting offline snapshot 3ffad3fa-2a8d-4f00-b5ae-a4796531b097 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] snapshot_file for this snap is: volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f51737-e1f7-4a0c-9415-7463733197cb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:59 devstack sudo[111151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:31:59 devstack sudo[111151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:59 devstack sudo[111151]: pam_unix(sudo:session): session closed for user root Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.388s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ddb7f-c98d-4de3-959a-bbcc2db1fd24]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:31:59 devstack sudo[111156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:31:59 devstack sudo[111156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:31:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Flow 'volume_create_manager' (61810be0-8ea2-4015-b605-e7689be19a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e5bc3a-c8d0-460b-9b6d-3c345a06df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1e5bc3a-c8d0-460b-9b6d-3c345a06df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1034212903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=723deb82-09a6-4e74-b8d4-d35cc44b2b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c02359418a429bbd94fd5ebdf71aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1288b666-8f30-4599-a854-bb0e858efea6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:00Z,use_quota=True,user_id='2474d4e0c6d048f3b2fa94924926e4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e27794-9bda-4f1c-8c12-6781a8932210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6e27794-9bda-4f1c-8c12-6781a8932210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f13d1-8bd8-4432-9cf9-3c5f19a6ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (322f13d1-8bd8-4432-9cf9-3c5f19a6ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '723deb82-09a6-4e74-b8d4-d35cc44b2b80', 'volume_name': 'volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80', 'volume_size': 1, 'snapshot_id': '1288b666-8f30-4599-a854-bb0e858efea6'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2151077c-ef9d-4434-b1a7-8b82f3ed2509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2151077c-ef9d-4434-b1a7-8b82f3ed2509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f1e10d-6f7d-4175-ac86-71339cddb165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Volume 723deb82-09a6-4e74-b8d4-d35cc44b2b80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80', 'volume_size': 1, 'snapshot_id': '1288b666-8f30-4599-a854-bb0e858efea6'} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6-723deb82-09a6-4e74-b8d4-d35cc44b2b80" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6-723deb82-09a6-4e74-b8d4-d35cc44b2b80" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Creating volume 723deb82-09a6-4e74-b8d4-d35cc44b2b80 from snapshot 1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] snapshot: 1288b666-8f30-4599-a854-bb0e858efea6, volume: 723deb82-09a6-4e74-b8d4-d35cc44b2b80, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:32:00 devstack sudo[111156]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:00 devstack sudo[111163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:32:00 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e022464-95c7-42a0-a0ea-b201e380d4a0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:00 devstack sudo[111167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:32:00 devstack sudo[111167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:00 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.469s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:00 devstack sudo[111177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097 Aug 17 16:32:00 devstack sudo[111177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:00 devstack sudo[111167]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.506s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209a8806-931b-44fa-aa43-e3cd34d74a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20ceb10-52b9-4a04-9741-3370458eeafe]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:00 devstack sudo[111180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:32:00 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:01 devstack sudo[111177]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.3ffad3fa-2a8d-4f00-b5ae-a4796531b097" returned: 0 in 0.399s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-3ffad3fa-2a8d-4f00-b5ae-a4796531b097" released by "_delete_snapshot" :: held 1.802s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" released by "delete_snapshot" :: held 1.831s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Created reservations ['835c7de5-c064-4e0c-a3c1-80f8b14e82f0', '57cba817-fa79-44a6-b2e1-82c00835698c', '7cc9cc9a-8de1-4fd3-8d4e-56f9a49e0b6e', '0f021d8d-705f-41e0-bce0-37d3e577fe6e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Delete snapshot completed successfully. Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4f88ab07-fa78-4959-91da-88602318689c tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-3ffad3fa-2a8d-4f00-b5ae-a4796531b097-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-e57d1965-b23c-4dd0-9335-2d0890b592f8-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:01 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.689s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-e57d1965-b23c-4dd0-9335-2d0890b592f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:01 devstack sudo[111197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 Aug 17 16:32:01 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" acquired by "delete_snapshot" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-e57d1965-b23c-4dd0-9335-2d0890b592f8" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-e57d1965-b23c-4dd0-9335-2d0890b592f8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Deleting offline snapshot e57d1965-b23c-4dd0-9335-2d0890b592f8 of volume 5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] snapshot_file for this snap is: volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbe7cf5-709e-4eda-aa5c-0416f26d261b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:01 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:32:01 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:02 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.476s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5490632b-2727-4903-b535-34772db75f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99d15e-1fc6-45ec-a3a0-aa4f7e288418]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:02 devstack sudo[111212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 Aug 17 16:32:02 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:02 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93" returned: 0 in 0.748s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:03 devstack sudo[111219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:32:03 devstack sudo[111219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:03 devstack sudo[111219]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 0.912s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:03 devstack sudo[111225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8 Aug 17 16:32:03 devstack sudo[111225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:04 devstack sudo[111225]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93.e57d1965-b23c-4dd0-9335-2d0890b592f8" returned: 0 in 1.006s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:04 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=83,cinder:INSERT=27,cinder:UPDATE=80,cinder:DELETE=6 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:32:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-e57d1965-b23c-4dd0-9335-2d0890b592f8" released by "_delete_snapshot" :: held 3.452s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" released by "delete_snapshot" :: held 3.499s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Created reservations ['2e459e3b-3d29-49fe-8a3f-abfb611e10a7', 'efb9e360-cc94-41b7-b8a4-3ec9316886a2', '624f34e4-9a6a-4185-a085-ac6face72aab', '399c0ba3-0160-4fb7-8b96-e4027038ac78'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Delete snapshot completed successfully. Aug 17 16:32:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a2ab00a1-42b6-4ee7-a9f3-302f6eb30c33 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-e57d1965-b23c-4dd0-9335-2d0890b592f8-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-5490632b-2727-4903-b535-34772db75f93-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-5490632b-2727-4903-b535-34772db75f93-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126d7ff-0115-4476-852e-5d5d7d21fa65]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-d54b23ae-082d-428b-9b91-6ca22e611fd2 req-39fc1d41-403c-4a41-8596-50240a06bc86 tempest-TestShelveInstance-135885357 None] Terminate volume connection completed successfully. Aug 17 16:32:07 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-d54b23ae-082d-428b-9b91-6ca22e611fd2 req-39fc1d41-403c-4a41-8596-50240a06bc86 tempest-TestShelveInstance-135885357 None] Deleting attachment 9540ffd3-e387-465c-91cb-aec6cb3ab686. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:32:07 devstack sudo[111251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 Aug 17 16:32:07 devstack sudo[111251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:08 devstack sudo[111251]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93" returned: 0 in 1.285s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:08 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93 Aug 17 16:32:08 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:08 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5490632b-2727-4903-b535-34772db75f93" returned: 0 in 0.559s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-quobyte-5490632b-2727-4903-b535-34772db75f93" released by "delete_volume" :: held 2.037s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Created reservations ['f3450cc9-6c2b-4462-8332-98b5f5f1b01a', '1cfdbb03-112c-4fc4-8f9a-f2c4dfb77176', '311e2f05-f976-4e47-b5de-fe1c02d937d6', '48d850b5-310e-4741-936a-fbfb2e7188ff'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:09 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80" returned: 0 in 7.663s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36, size 1024.00 MB, duration 7.66 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:32:09 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Converted 1024.00 MB image at 133.62 MB/s Aug 17 16:32:09 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 is being set with open permissions: ugo+rw Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:09 devstack sudo[111259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:09 devstack sudo[111259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:09 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:32:09 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:09 devstack sudo[111259]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" released by "_copy_volume_from_snapshot" :: held 9.411s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:09 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.416s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:32:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Deleted volume successfully. Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6-723deb82-09a6-4e74-b8d4-d35cc44b2b80" released by "_create_volume_from_snapshot" :: held 9.570s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.589s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f9985ab-56e3-4f24-8e52-e3b8d5f45ff1 tempest-VolumesSnapshotListTestJSON-1670095085 None] Lock "cinder-5490632b-2727-4903-b535-34772db75f93-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f1e10d-6f7d-4175-ac86-71339cddb165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80', 'volume_size': 1, 'snapshot_id': '1288b666-8f30-4599-a854-bb0e858efea6'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79ff948-d613-456b-8b48-8b9a25b7d464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:09 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Volume volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 (723deb82-09a6-4e74-b8d4-d35cc44b2b80): created successfully Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79ff948-d613-456b-8b48-8b9a25b7d464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:09 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Flow 'volume_create_manager' (61810be0-8ea2-4015-b605-e7689be19a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ae4f5c3b-a1ad-4da6-a8c4-87ed97c4f67b tempest-TestStampPattern-1769570272 None] Created volume successfully. Aug 17 16:32:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7173173-9a7c-427f-b25f-3caab4bb3d21 req-d45eb0ca-843c-49d9-8e4b-7838ee53d627 tempest-TestShelveInstance-135885357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7173173-9a7c-427f-b25f-3caab4bb3d21 req-d45eb0ca-843c-49d9-8e4b-7838ee53d627 tempest-TestShelveInstance-135885357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a7173173-9a7c-427f-b25f-3caab4bb3d21 req-d45eb0ca-843c-49d9-8e4b-7838ee53d627 tempest-TestShelveInstance-135885357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:11 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a7173173-9a7c-427f-b25f-3caab4bb3d21 req-d45eb0ca-843c-49d9-8e4b-7838ee53d627 tempest-TestShelveInstance-135885357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-753b5eab-0d66-4ed7-8408-5e63c3127200', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0aeb411-f6c2-45ba-b790-50e55464846a', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:32:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a7173173-9a7c-427f-b25f-3caab4bb3d21 req-d45eb0ca-843c-49d9-8e4b-7838ee53d627 tempest-TestShelveInstance-135885357 None] attachment_update completed successfully. Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Flow 'volume_create_manager' (eb01fa6c-5049-4ec8-8abc-41015c4f9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ad6dc-3be7-4c8e-913e-2dd9f316e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ad6dc-3be7-4c8e-913e-2dd9f316e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-294797301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d26da0-a795-4305-854c-5a270de54076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738a3aef1ad845589782026e8d1184d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:16Z,use_quota=True,user_id='0a97f5f22aa1498b9e8495c894d301d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b29a5-992d-43d5-80d8-f663237aa4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b29a5-992d-43d5-80d8-f663237aa4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00832d5a-347b-4431-a898-fe3ff65889a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00832d5a-347b-4431-a898-fe3ff65889a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d26da0-a795-4305-854c-5a270de54076', 'volume_name': 'volume-11d26da0-a795-4305-854c-5a270de54076', 'volume_size': 2}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a403f563-20fb-4425-9f2a-e03328c371dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a403f563-20fb-4425-9f2a-e03328c371dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67f52b6-e0d1-453c-a7a7-6f4711c42c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:16 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Volume 11d26da0-a795-4305-854c-5a270de54076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d26da0-a795-4305-854c-5a270de54076', 'volume_size': 2} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-294797301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d26da0-a795-4305-854c-5a270de54076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='738a3aef1ad845589782026e8d1184d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:16Z,use_quota=True,user_id='0a97f5f22aa1498b9e8495c894d301d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Creating volume 11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:32:16 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:32:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 2147483648 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:16 devstack sudo[111463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 2147483648 Aug 17 16:32:16 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:17 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 2147483648" returned: 0 in 1.199s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:17 devstack sudo[111809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 Aug 17 16:32:17 devstack sudo[111809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:18 devstack sudo[111809]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076" returned: 0 in 0.393s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67f52b6-e0d1-453c-a7a7-6f4711c42c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d26da0-a795-4305-854c-5a270de54076', 'volume_size': 2}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e45b7e5-9963-4194-a859-436b475b356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:18 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Volume volume-11d26da0-a795-4305-854c-5a270de54076 (11d26da0-a795-4305-854c-5a270de54076): created successfully Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e45b7e5-9963-4194-a859-436b475b356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Flow 'volume_create_manager' (eb01fa6c-5049-4ec8-8abc-41015c4f9563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-94e9dbac-baf6-4b82-9590-1df9c3771c9d tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Created volume successfully. Aug 17 16:32:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Creating offline snapshot 2f818727-f406-4495-9939-f9f01a4e1bf5 of volume 11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:32:19 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95fcd7-1f5d-4e49-9c3e-e7722db5bc76]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:19 devstack sudo[111834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 Aug 17 16:32:19 devstack sudo[111834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:20 devstack sudo[111834]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076" returned: 0 in 0.902s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 2G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:20 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 2G Aug 17 16:32:20 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:20 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 2G" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d26da0-a795-4305-854c-5a270de54076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:20 devstack sudo[111849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d26da0-a795-4305-854c-5a270de54076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 Aug 17 16:32:20 devstack sudo[111849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:21 devstack sudo[111849]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d26da0-a795-4305-854c-5a270de54076 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5" returned: 0 in 0.353s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:21 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 is being set with open permissions: ugo+rw Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:21 devstack sudo[111854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 Aug 17 16:32:21 devstack sudo[111854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:21 devstack sudo[111854]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5" returned: 0 in 0.357s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:21 devstack sudo[111857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info Aug 17 16:32:21 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:21 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info" returned: 0 in 0.339s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:21 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info is being set with open permissions: ugo+rw Aug 17 16:32:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:22 devstack sudo[111860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info Aug 17 16:32:22 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:22 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.info" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.935s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d26587c2-05c2-4b27-90f0-52144fe443b4 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Create snapshot completed successfully Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "cinder-2f818727-f406-4495-9939-f9f01a4e1bf5-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-2f818727-f406-4495-9939-f9f01a4e1bf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" acquired by "delete_snapshot" :: waited 0.052s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "cinder-quobyte-2f818727-f406-4495-9939-f9f01a4e1bf5" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-2f818727-f406-4495-9939-f9f01a4e1bf5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Deleting offline snapshot 2f818727-f406-4495-9939-f9f01a4e1bf5 of volume 11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] snapshot_file for this snap is: volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ec54a-7b3d-45ab-9156-874b258b048b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:22 devstack sudo[111863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 Aug 17 16:32:22 devstack sudo[111863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:23 devstack sudo[111863]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d26da0-a795-4305-854c-5a270de54076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[77838d1e-7b6e-4b9a-9658-9435016dae77]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:23 devstack sudo[111868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 Aug 17 16:32:23 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:23 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:23 devstack sudo[111875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 Aug 17 16:32:23 devstack sudo[111875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:24 devstack sudo[111875]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5" returned: 0 in 0.386s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:24 devstack sudo[111881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5 Aug 17 16:32:24 devstack sudo[111881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:24 devstack sudo[111881]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076.2f818727-f406-4495-9939-f9f01a4e1bf5" returned: 0 in 0.303s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-2f818727-f406-4495-9939-f9f01a4e1bf5" released by "_delete_snapshot" :: held 1.598s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" released by "delete_snapshot" :: held 1.632s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Created reservations ['8b3dff45-da03-4764-8cd5-6450b1831ba0', '509b0678-5ec0-4296-b321-29571e6c3401', '690dc833-2bed-42f2-9b13-f0525b42c3ae', '0fe12a31-4c34-49a6-a48e-9187f162b237'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Delete snapshot completed successfully. Aug 17 16:32:24 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-aebd3d4b-e9c8-4134-b14c-18b9a60a8fcb tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-2f818727-f406-4495-9939-f9f01a4e1bf5-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "cinder-11d26da0-a795-4305-854c-5a270de54076-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-11d26da0-a795-4305-854c-5a270de54076-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e4650-f545-4ccc-bdc5-d6d1f41650a0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:25 devstack sudo[111884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 Aug 17 16:32:25 devstack sudo[111884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:25 devstack sudo[111884]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076" returned: 0 in 0.374s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:25 devstack sudo[111889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076 Aug 17 16:32:25 devstack sudo[111889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:25 devstack sudo[111889]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-11d26da0-a795-4305-854c-5a270de54076" returned: 0 in 0.298s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-quobyte-11d26da0-a795-4305-854c-5a270de54076" released by "delete_volume" :: held 0.740s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:25 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Created reservations ['e6811469-b73b-4f0b-a2d5-048e5a9d4bc7', 'b30cfde0-22e7-4436-a13e-a5c95c76dc53', '07c6a6a3-51c8-4417-8925-25ee7f316a83', 'ce2f758d-ce36-43f3-8448-7976fd978803'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:26 devstack sudo[111892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:32:26 devstack sudo[111892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:26 devstack sudo[111892]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:32:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Deleted volume successfully. Aug 17 16:32:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7177a08-865b-43bd-8bb2-e972ab17c3f9 tempest-VolumesSnapshotNegativeTestJSON-1559951566 None] Lock "cinder-11d26da0-a795-4305-854c-5a270de54076-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:36 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=56,cinder:UPDATE=51,cinder:DELETE=7,cinder:INSERT=12 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:32:36 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=29,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:32:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a2b656f6-35da-4e2c-9824-159ce3e3d66c req-d57a8ecc-d2f5-4ce3-9fa5-75eb64500955 tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a2b656f6-35da-4e2c-9824-159ce3e3d66c req-d57a8ecc-d2f5-4ce3-9fa5-75eb64500955 tempest-TestStampPattern-1769570272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-a2b656f6-35da-4e2c-9824-159ce3e3d66c req-d57a8ecc-d2f5-4ce3-9fa5-75eb64500955 tempest-TestStampPattern-1769570272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a2b656f6-35da-4e2c-9824-159ce3e3d66c req-d57a8ecc-d2f5-4ce3-9fa5-75eb64500955 tempest-TestStampPattern-1769570272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af75a0a7-9716-43b8-ac08-36b511f6efd0', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:32:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a2b656f6-35da-4e2c-9824-159ce3e3d66c req-d57a8ecc-d2f5-4ce3-9fa5-75eb64500955 tempest-TestStampPattern-1769570272 None] attachment_update completed successfully. Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:46 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:32:46 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:47 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:32:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-8917428d-7b79-4bf4-b84c-c98de970583c req-5330f93c-085c-4a46-b73e-2c4528b35dba tempest-TestStampPattern-1769570272 None] Terminate volume connection completed successfully. Aug 17 16:32:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-8917428d-7b79-4bf4-b84c-c98de970583c req-5330f93c-085c-4a46-b73e-2c4528b35dba tempest-TestStampPattern-1769570272 None] Deleting attachment af75a0a7-9716-43b8-ac08-36b511f6efd0. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-723deb82-09a6-4e74-b8d4-d35cc44b2b80-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "cinder-723deb82-09a6-4e74-b8d4-d35cc44b2b80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" acquired by "delete_volume" :: waited 0.014s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa002ed0-edb1-4f63-b5b0-adaf48344c4c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:53 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 Aug 17 16:32:53 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:53 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:53 devstack sudo[112066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80 Aug 17 16:32:53 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:53 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-723deb82-09a6-4e74-b8d4-d35cc44b2b80" returned: 0 in 0.296s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-723deb82-09a6-4e74-b8d4-d35cc44b2b80" released by "delete_volume" :: held 0.704s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Created reservations ['42a9f7cf-7adc-4b46-8054-490da9420bb4', 'c0e6877e-a82b-4941-89c8-40a43a640fff', 'fe43410a-18cc-4f0c-b236-32f91e87c7ed', '5bb4b7b3-ab3a-4361-bc7f-e10ee3b6a7ee'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:53 devstack sudo[112075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:32:53 devstack sudo[112075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:54 devstack sudo[112075]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:32:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Deleted volume successfully. Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e044bd67-1b89-419f-9e13-892ee8bd647d tempest-TestStampPattern-1769570272 None] Lock "cinder-723deb82-09a6-4e74-b8d4-d35cc44b2b80-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (836ccdc1-ec8b-410a-9e99-c64149476e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea98874-b84a-4cdc-bbdf-2b4f8522d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea98874-b84a-4cdc-bbdf-2b4f8522d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1681609417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03bc927-0d6d-4fb5-8046-3c19a07d19a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:54Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4554c6-53ec-42db-bc12-a555dc1e4c82),volume_type_id=0b4554c6-53ec-42db-bc12-a555dc1e4c82)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc85f939-55d2-4be7-af7c-4f5f61f46343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc85f939-55d2-4be7-af7c-4f5f61f46343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fe225d-ea59-4b35-a066-98667d17350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fe225d-ea59-4b35-a066-98667d17350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03bc927-0d6d-4fb5-8046-3c19a07d19a3', 'volume_name': 'volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f917ad7b-ba48-4523-88d8-a8a732323407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f917ad7b-ba48-4523-88d8-a8a732323407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8786668e-fa17-4d1c-a124-908494266079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Volume c03bc927-0d6d-4fb5-8046-3c19a07d19a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3', 'volume_size': 1} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1681609417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03bc927-0d6d-4fb5-8046-3c19a07d19a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:54Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4554c6-53ec-42db-bc12-a555dc1e4c82),volume_type_id=0b4554c6-53ec-42db-bc12-a555dc1e4c82)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Creating volume c03bc927-0d6d-4fb5-8046-3c19a07d19a3 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:32:54 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:54 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 1073741824 Aug 17 16:32:54 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-1288b666-8f30-4599-a854-bb0e858efea6-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-1288b666-8f30-4599-a854-bb0e858efea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Deleting offline snapshot 1288b666-8f30-4599-a854-bb0e858efea6 of volume 209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] snapshot_file for this snap is: volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a5856-3562-41c9-89e2-20ee3a5615bc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:54 devstack sudo[112083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:32:54 devstack sudo[112083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (b3bf34f3-09d3-4501-aa8a-611abc134691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3e659b-5159-4df7-8e6b-7cfb14841918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3e659b-5159-4df7-8e6b-7cfb14841918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-575294733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c9ab51-23b1-4c55-bf08-4db66d8d16dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:55Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9290fc6f-c365-4f3c-9d89-cab1c633ae28),volume_type_id=9290fc6f-c365-4f3c-9d89-cab1c633ae28)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b678e246-0c7a-47b7-bd9d-84c2118787f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b678e246-0c7a-47b7-bd9d-84c2118787f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b55925a-162d-401b-9c67-97d7b27a2778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b55925a-162d-401b-9c67-97d7b27a2778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c9ab51-23b1-4c55-bf08-4db66d8d16dc', 'volume_name': 'volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e42f1-ca4f-4ae4-b869-4172f4f91cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e42f1-ca4f-4ae4-b869-4172f4f91cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c47c55-0366-40af-a113-84f6dda5cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Volume 80c9ab51-23b1-4c55-bf08-4db66d8d16dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc', 'volume_size': 1} Aug 17 16:32:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:55 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 1073741824" returned: 0 in 0.590s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:55 devstack sudo[112083]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.433s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-209a8806-931b-44fa-aa43-e3cd34d74a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1d3dd8-8eb1-4d53-b860-cb47732fad53]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:55 devstack sudo[112094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 Aug 17 16:32:55 devstack sudo[112094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:55 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:32:55 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:55 devstack sudo[112094]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-575294733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c9ab51-23b1-4c55-bf08-4db66d8d16dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:55Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9290fc6f-c365-4f3c-9d89-cab1c633ae28),volume_type_id=9290fc6f-c365-4f3c-9d89-cab1c633ae28)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Creating volume 80c9ab51-23b1-4c55-bf08-4db66d8d16dc {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:32:55 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8786668e-fa17-4d1c-a124-908494266079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc 1073741824 Aug 17 16:32:55 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd3565-771f-460d-845a-800f736383d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Volume volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 (c03bc927-0d6d-4fb5-8046-3c19a07d19a3): created successfully Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd3565-771f-460d-845a-800f736383d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (836ccdc1-ec8b-410a-9e99-c64149476e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-11aaf515-3555-4df3-b470-e642a2c9801e tempest-TestInstancesWithCinderVolumes-540805210 None] Created volume successfully. Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (8bdb1bec-111a-420b-afef-38eaca73453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e483fe7b-dc55-418e-ae75-674ee3a65043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e483fe7b-dc55-418e-ae75-674ee3a65043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-333219453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be295e2-63cf-4bb7-abed-deda5a2caf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:55Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a78146a-f3ce-45a3-af21-703ea4ad9c12),volume_type_id=2a78146a-f3ce-45a3-af21-703ea4ad9c12)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbcb600-dc2b-40da-9a94-c7246ff9d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbcb600-dc2b-40da-9a94-c7246ff9d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d3c6d-c298-40bf-8442-6c9272b829ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:32:55 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.643s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:55 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:32:55 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6d3c6d-c298-40bf-8442-6c9272b829ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0be295e2-63cf-4bb7-abed-deda5a2caf7d', 'volume_name': 'volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d', 'volume_size': 1, 'image_id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--560172483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ba5b7d1c7c74f878487d25d55da3c0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'created_at': datetime.datetime(2026, 8, 17, 14, 32, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6a76160-95e8-45ed-b84f-91f993429e58/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e10eb81-f07d-4f34-b9d3-309424cb8638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e10eb81-f07d-4f34-b9d3-309424cb8638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6aa42-e2ef-4061-99b9-8f83c9c3d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:55 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d', 'volume_size': 1, 'image_id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--560172483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ba5b7d1c7c74f878487d25d55da3c0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'created_at': datetime.datetime(2026, 8, 17, 14, 32, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6a76160-95e8-45ed-b84f-91f993429e58/file', 'properties': {}}, 'image_service': } Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Trying to clone 0be295e2-63cf-4bb7-abed-deda5a2caf7d from image f6a76160-95e8-45ed-b84f-91f993429e58 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:32:55 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc 1073741824" returned: 0 in 0.503s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:56 devstack sudo[112116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc Aug 17 16:32:56 devstack sudo[112116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:56 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.422s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:56 devstack sudo[112121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6 Aug 17 16:32:56 devstack sudo[112121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:32:56 devstack sudo[112116]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c47c55-0366-40af-a113-84f6dda5cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95363058-16a5-44f8-b925-a6286f5fa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:32:56 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Volume volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc (80c9ab51-23b1-4c55-bf08-4db66d8d16dc): created successfully Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95363058-16a5-44f8-b925-a6286f5fa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (b3bf34f3-09d3-4501-aa8a-611abc134691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:32:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f61b057c-dbea-4e32-ae0c-2aa419169564 tempest-TestInstancesWithCinderVolumes-540805210 None] Created volume successfully. Aug 17 16:32:56 devstack sudo[112121]: pam_unix(sudo:session): session closed for user root Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36.1288b666-8f30-4599-a854-bb0e858efea6" returned: 0 in 0.363s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-1288b666-8f30-4599-a854-bb0e858efea6" released by "_delete_snapshot" :: held 1.986s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" released by "delete_snapshot" :: held 2.022s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Created reservations ['e06acee0-c133-468a-a2fd-541a25aa9496', '9d9db3b4-de10-437a-864e-776ecb672a12', 'b3ce0050-0a7f-4ba7-998e-c2ba2fcd2ce5', '89da610a-890a-4426-b92b-4b461330853e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:32:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Delete snapshot completed successfully. Aug 17 16:32:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a21591b6-d5a5-4e83-af25-3822eaac8c60 tempest-TestStampPattern-1769570272 None] Lock "cinder-1288b666-8f30-4599-a854-bb0e858efea6-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:32:59 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-4b551341-8d88-41db-bb79-2eb49727e730 req-2744b0a1-b3b1-4c5d-9624-bf632ea0c0fe tempest-TestShelveInstance-135885357 None] Terminate volume connection completed successfully. Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-4b551341-8d88-41db-bb79-2eb49727e730 req-2744b0a1-b3b1-4c5d-9624-bf632ea0c0fe tempest-TestShelveInstance-135885357 None] Deleting attachment d0aeb411-f6c2-45ba-b790-50e55464846a. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Acquiring lock "cinder-753b5eab-0d66-4ed7-8408-5e63c3127200-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "cinder-753b5eab-0d66-4ed7-8408-5e63c3127200-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Acquiring lock "cinder-quobyte-753b5eab-0d66-4ed7-8408-5e63c3127200" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "cinder-quobyte-753b5eab-0d66-4ed7-8408-5e63c3127200" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e68a058-cce0-489e-85df-db68d03db4a7]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:32:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:32:59 devstack sudo[112156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 Aug 17 16:32:59 devstack sudo[112156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:00 devstack sudo[112156]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200" returned: 0 in 0.572s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:00 devstack sudo[112170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200 Aug 17 16:33:00 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:00 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-753b5eab-0d66-4ed7-8408-5e63c3127200" returned: 0 in 0.426s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "cinder-quobyte-753b5eab-0d66-4ed7-8408-5e63c3127200" released by "delete_volume" :: held 1.065s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG cinder.quota [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Created reservations ['b715e210-686b-4677-a4c9-e2c9a610fd50', '3d884942-8c8a-4e57-9383-a9eda7d4d7ce', '1d4fe403-6d6b-4644-8242-bccb01a7cae5', 'bc477ebf-77d1-4c99-a3c5-d7dff76db87f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:00 devstack sudo[112188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:00 devstack sudo[112188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:00 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD, size 20.69 MB, duration 5.09 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:33:00 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Image download 20.69 MB at 4.06 MB/s Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de0b36-4838-403a-9c36-a1e95b9834d2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:01 devstack sudo[112188]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.manager [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Deleted volume successfully. Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [req-4b551341-8d88-41db-bb79-2eb49727e730 req-a990067f-78f7-406c-9c1d-adb3d8706701 tempest-TestShelveInstance-135885357 None] Lock "cinder-753b5eab-0d66-4ed7-8408-5e63c3127200-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:01 devstack sudo[112190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD Aug 17 16:33:01 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:01 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD" returned: 0 in 0.483s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Temporary image f6a76160-95e8-45ed-b84f-91f993429e58 is fetched for user 3b9b42af77d9473e982be5f2a47452c6. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a464c-0502-4c49-838f-67b34bf4b99c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:01 devstack sudo[112197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD Aug 17 16:33:01 devstack sudo[112197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:01 devstack sudo[112197]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-333219453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0be295e2-63cf-4bb7-abed-deda5a2caf7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba5b7d1c7c74f878487d25d55da3c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:32:55Z,use_quota=True,user_id='3b9b42af77d9473e982be5f2a47452c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a78146a-f3ce-45a3-af21-703ea4ad9c12),volume_type_id=2a78146a-f3ce-45a3-af21-703ea4ad9c12)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Creating volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:01 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:02 devstack sudo[112202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1073741824 Aug 17 16:33:02 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:02 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1073741824" returned: 0 in 0.602s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:02 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d Aug 17 16:33:02 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:02 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Attempting download of f6a76160-95e8-45ed-b84f-91f993429e58 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}])) to volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac46c47-a1ac-4c4d-ba54-b0356e6dcb13]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:03 devstack sudo[112212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah Aug 17 16:33:03 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:03 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah" returned: 0 in 0.384s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-209a8806-931b-44fa-aa43-e3cd34d74a36-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "cinder-209a8806-931b-44fa-aa43-e3cd34d74a36-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Acquiring lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:03 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah Aug 17 16:33:03 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c6f0e9-0fd3-4e03-9ebd-d8ceeed0a40a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:03 devstack sudo[112220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:33:03 devstack sudo[112220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:03 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah" returned: 1 in 0.397s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f6a76160-95e8-45ed-b84f-91f993429e58_4ru0xvah' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb449978-3c2a-4a34-a458-4756b951fd80]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:03 devstack sudo[112225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD Aug 17 16:33:03 devstack sudo[112225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:03 devstack sudo[112220]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.399s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:03 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36 Aug 17 16:33:03 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:04 devstack sudo[112225]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] f6a76160-95e8-45ed-b84f-91f993429e58 was qcow2, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:04 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d Aug 17 16:33:04 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:04 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-209a8806-931b-44fa-aa43-e3cd34d74a36" returned: 0 in 0.272s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "cinder-quobyte-209a8806-931b-44fa-aa43-e3cd34d74a36" released by "delete_volume" :: held 0.736s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Created reservations ['22bef527-7eb0-4797-b2a4-2334b672a6ea', '0abba607-c8b1-46e3-b414-86cf015ee4df', '90356c4f-c3d0-4838-8cc7-f644a1cf4732', '3c1d7e65-2648-4548-ac76-e043b3a5ad7f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:04 devstack sudo[112242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:04 devstack sudo[112242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:04 devstack sudo[112242]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.280s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Deleted volume successfully. Aug 17 16:33:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f62984f8-8b01-458b-aaa4-d6de66d12adc tempest-TestStampPattern-1769570272 None] Lock "cinder-209a8806-931b-44fa-aa43-e3cd34d74a36-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:06 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d" returned: 0 in 2.186s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f6a76160-95e8-45ed-b84f-91f993429e58_2y5496s8devstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:33:06 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Converted 112.00 MB image at 51.21 MB/s Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:06 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1G Aug 17 16:33:06 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:06 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d 1G" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Downloaded image f6a76160-95e8-45ed-b84f-91f993429e58 ((None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}])) to volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Temporary image f6a76160-95e8-45ed-b84f-91f993429e58 for user 3b9b42af77d9473e982be5f2a47452c6 is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Marking volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Copying metadata from image f6a76160-95e8-45ed-b84f-91f993429e58 to 0be295e2-63cf-4bb7-abed-deda5a2caf7d. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Creating volume glance metadata for volume 0be295e2-63cf-4bb7-abed-deda5a2caf7d backed by image f6a76160-95e8-45ed-b84f-91f993429e58 with: {'image_id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'image_name': 'tempest-scenario-img--560172483', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6aa42-e2ef-4061-99b9-8f83c9c3d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d', 'volume_size': 1, 'image_id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f6a76160-95e8-45ed-b84f-91f993429e58', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--560172483', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ba5b7d1c7c74f878487d25d55da3c0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f6a76160-95e8-45ed-b84f-91f993429e58', 'created_at': datetime.datetime(2026, 8, 17, 14, 32, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 32, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f6a76160-95e8-45ed-b84f-91f993429e58/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795eee2-5bbb-476f-954a-69f0b3f95fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:06 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Volume volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d (0be295e2-63cf-4bb7-abed-deda5a2caf7d): created successfully Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7795eee2-5bbb-476f-954a-69f0b3f95fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Flow 'volume_create_manager' (8bdb1bec-111a-420b-afef-38eaca73453d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0a3bcd07-0a4a-4251-8d47-039179b9e0be tempest-TestInstancesWithCinderVolumes-540805210 None] Created volume successfully. Aug 17 16:33:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef047ebb-0752-4e31-b001-ea8e0336d144 req-7e08f40e-36b9-44e3-8f1e-cc686bbc62b9 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef047ebb-0752-4e31-b001-ea8e0336d144 req-7e08f40e-36b9-44e3-8f1e-cc686bbc62b9 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-ef047ebb-0752-4e31-b001-ea8e0336d144 req-7e08f40e-36b9-44e3-8f1e-cc686bbc62b9 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-ef047ebb-0752-4e31-b001-ea8e0336d144 req-7e08f40e-36b9-44e3-8f1e-cc686bbc62b9 tempest-TestInstancesWithCinderVolumes-540805210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c18e3c-4c21-4104-bc98-3535a1254d00', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:33:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-ef047ebb-0752-4e31-b001-ea8e0336d144 req-7e08f40e-36b9-44e3-8f1e-cc686bbc62b9 tempest-TestInstancesWithCinderVolumes-540805210 None] attachment_update completed successfully. Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (68f9a75e-c8e3-48a0-b8ac-afe0dc00f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddb3474-4aef-401c-bc04-73350b2ecd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddb3474-4aef-401c-bc04-73350b2ecd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491532919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe98c646-7e98-4d2c-9f03-768cee344da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:21Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8cd2c0-839f-447e-82e8-9db4186974fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8cd2c0-839f-447e-82e8-9db4186974fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cdfc5e-6ace-4731-8d72-a6355afd0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67cdfc5e-6ace-4731-8d72-a6355afd0924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe98c646-7e98-4d2c-9f03-768cee344da2', 'volume_name': 'volume-fe98c646-7e98-4d2c-9f03-768cee344da2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73ea0de-f921-450f-9f46-69f56c511fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73ea0de-f921-450f-9f46-69f56c511fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827c7c7-884b-438a-8736-0fb0ae2cecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume fe98c646-7e98-4d2c-9f03-768cee344da2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe98c646-7e98-4d2c-9f03-768cee344da2', 'volume_size': 1} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-491532919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe98c646-7e98-4d2c-9f03-768cee344da2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:21Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:21 devstack sudo[112737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 1073741824 Aug 17 16:33:21 devstack sudo[112737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:21 devstack sudo[112737]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 1073741824" returned: 0 in 0.683s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:22 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 Aug 17 16:33:22 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:22 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2" returned: 0 in 0.378s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827c7c7-884b-438a-8736-0fb0ae2cecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe98c646-7e98-4d2c-9f03-768cee344da2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833c83d-cc72-4fda-a620-844f013b7d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-fe98c646-7e98-4d2c-9f03-768cee344da2 (fe98c646-7e98-4d2c-9f03-768cee344da2): created successfully Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c833c83d-cc72-4fda-a620-844f013b7d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (68f9a75e-c8e3-48a0-b8ac-afe0dc00f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b5913c5a-57d4-4740-9c15-e39f416137b5 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating offline snapshot 78abec3c-30e7-42c7-95ef-f83cb38e8c6c of volume fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:33:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cba7cb5-3823-4f95-9b6e-113456b068e9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:23 devstack sudo[112746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 Aug 17 16:33:23 devstack sudo[112746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:24 devstack sudo[112746]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2" returned: 0 in 0.516s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:24 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c 1G Aug 17 16:33:24 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:24 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c 1G" returned: 0 in 0.775s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe98c646-7e98-4d2c-9f03-768cee344da2 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:24 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe98c646-7e98-4d2c-9f03-768cee344da2 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c Aug 17 16:33:24 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Flow 'volume_create_manager' (5ce86341-379c-48f8-a85d-54162d8f56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2878c1b5-0964-4f4a-8fa4-c24a409c1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2878c1b5-0964-4f4a-8fa4-c24a409c1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b347c-4ed0-4d2f-b97c-47d79604b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f156a83bdb24619aa0eefcbe5d46993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:25Z,use_quota=True,user_id='21d21f2b3d654b77b99c7693df138189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03dfb8cc-00d4-4876-9148-c10b6dae9600),volume_type_id=03dfb8cc-00d4-4876-9148-c10b6dae9600)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e7460-ecac-440e-a9f6-af5465dd2999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (154e7460-ecac-440e-a9f6-af5465dd2999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3e242f-a369-42b8-b8ea-2f69863ce86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:33:25 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe98c646-7e98-4d2c-9f03-768cee344da2 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:25 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c is being set with open permissions: ugo+rw Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:25 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c Aug 17 16:33:25 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3e242f-a369-42b8-b8ea-2f69863ce86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae7b347c-4ed0-4d2f-b97c-47d79604b3b0', 'volume_name': 'volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0', 'volume_size': 1, 'image_id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '470ae2f6727d9ebeb368417c359f28bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f156a83bdb24619aa0eefcbe5d46993', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe31ffbdced1542b311f18ae51828e24a8f8f493f82a6ff8e111fad32eee5a5895459d13da1e2c525b63fca2c3d6582020150c5168d66c61ed7719865a2e8043', 'id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'created_at': datetime.datetime(2026, 8, 17, 14, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51c12d4-9879-4ebf-bd7d-50dd7c7e9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51c12d4-9879-4ebf-bd7d-50dd7c7e9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb10df6-faa3-4479-94fa-7411515fc471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0', 'volume_size': 1, 'image_id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '470ae2f6727d9ebeb368417c359f28bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f156a83bdb24619aa0eefcbe5d46993', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe31ffbdced1542b311f18ae51828e24a8f8f493f82a6ff8e111fad32eee5a5895459d13da1e2c525b63fca2c3d6582020150c5168d66c61ed7719865a2e8043', 'id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'created_at': datetime.datetime(2026, 8, 17, 14, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Trying to clone ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 from image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:33:25 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c" returned: 0 in 0.335s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:33:25 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Image download 0.00 MB at 0.00 MB/s Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b500e08-ed53-42fe-8d62-86b5ae1cd2e6]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:25 devstack sudo[112768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info Aug 17 16:33:25 devstack sudo[112768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:26 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:26 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:26 devstack sudo[112768]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info" returned: 0 in 0.367s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:26 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info is being set with open permissions: ugo+rw Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:26 devstack sudo[112773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info Aug 17 16:33:26 devstack sudo[112773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:26 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:26 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:26 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:26 devstack sudo[112773]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.info" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.050s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-81993407-a0a6-4ee1-9ddb-eab05c73ef0d tempest-CreateVolumesFromSnapshotTest-385202924 None] Create snapshot completed successfully Aug 17 16:33:26 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 1 in 0.520s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Temporary image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 is fetched for user 21d21f2b3d654b77b99c7693df138189. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c36c2b-088e-4341-a7c0-7b408511413e]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:27 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:27 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:27 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 0 in 0.613s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (c7e0e877-5d34-4afe-9a81-f1c38f79e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00dec24-e16a-474e-acaf-181332a4f76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00dec24-e16a-474e-acaf-181332a4f76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746475643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e22017b-dfb1-476b-8901-8853c5a79b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:28Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ebf53-3670-4525-841d-75b68207ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:27 devstack sudo[112787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ebf53-3670-4525-841d-75b68207ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:27 devstack sudo[112787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e15f436-f037-4849-9761-281e6cf83812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e15f436-f037-4849-9761-281e6cf83812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e22017b-dfb1-476b-8901-8853c5a79b96', 'volume_name': 'volume-6e22017b-dfb1-476b-8901-8853c5a79b96', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c91824-2b50-4c8d-9786-13200f188d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c91824-2b50-4c8d-9786-13200f188d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e43e02-c6e7-4e58-8970-c9d540c5c436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume 6e22017b-dfb1-476b-8901-8853c5a79b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e22017b-dfb1-476b-8901-8853c5a79b96', 'volume_size': 1} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1746475643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e22017b-dfb1-476b-8901-8853c5a79b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:28Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume 6e22017b-dfb1-476b-8901-8853c5a79b96 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:27 devstack sudo[112789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 1073741824 Aug 17 16:33:27 devstack sudo[112789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (ec73ac79-f84d-4ba8-ab86-331697a4989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba12ea6d-6d1b-4475-9184-95151127748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack sudo[112787]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 1 in 0.736s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba12ea6d-6d1b-4475-9184-95151127748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937700590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cae453-25e2-4657-8972-8016c6ec49da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:28Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b136a0f6-90d9-416f-ad64-57d73c8be7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b136a0f6-90d9-416f-ad64-57d73c8be7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aceecf-e0dc-44ae-84c0-7454f6d2a09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aceecf-e0dc-44ae-84c0-7454f6d2a09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cae453-25e2-4657-8972-8016c6ec49da', 'volume_name': 'volume-f6cae453-25e2-4657-8972-8016c6ec49da', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9d4b12-3f95-4fa2-8cea-092e3b507960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9d4b12-3f95-4fa2-8cea-092e3b507960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3806dfcb-0aa0-4c7b-b5f2-153469c73ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume f6cae453-25e2-4657-8972-8016c6ec49da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cae453-25e2-4657-8972-8016c6ec49da', 'volume_size': 1} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:28 devstack sudo[112789]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 1073741824" returned: 0 in 0.640s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:28 devstack sudo[112798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 Aug 17 16:33:28 devstack sudo[112798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (f43da983-63af-47bd-b74f-6ab1bfdd5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c77af3-0205-494b-9905-b7548c9a0fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c77af3-0205-494b-9905-b7548c9a0fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f66b36-80dd-4041-bec2-bff3321f2329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:29Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8405bfbc-fe33-450e-b2cf-f07be59d3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8405bfbc-fe33-450e-b2cf-f07be59d3566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0f2bce-b1b4-4a3f-9928-80cfc4c5e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0f2bce-b1b4-4a3f-9928-80cfc4c5e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3f66b36-80dd-4041-bec2-bff3321f2329', 'volume_name': 'volume-a3f66b36-80dd-4041-bec2-bff3321f2329', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c23eb78-c56f-4e7c-8761-7466a78a6822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c23eb78-c56f-4e7c-8761-7466a78a6822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c73a7-6419-488a-ab8f-c08e88159979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume a3f66b36-80dd-4041-bec2-bff3321f2329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3f66b36-80dd-4041-bec2-bff3321f2329', 'volume_size': 1} Aug 17 16:33:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (29f4769f-01ac-4f30-8620-bcede10ad0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e47038-fe85-44d5-94fd-ccbd7b65a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e47038-fe85-44d5-94fd-ccbd7b65a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353123827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db117cd8-acc7-4eca-9cf2-2546d9f8ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:29Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d22a7a-fb68-414d-8fc1-ed80c37342bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d22a7a-fb68-414d-8fc1-ed80c37342bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack sudo[112798]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41069ca-78c1-428a-8673-6c6883678d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41069ca-78c1-428a-8673-6c6883678d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db117cd8-acc7-4eca-9cf2-2546d9f8ee58', 'volume_name': 'volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef7fbe8-8dd9-4613-b5bb-3a2103d7e427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ef7fbe8-8dd9-4613-b5bb-3a2103d7e427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf2c647-4a50-47d0-9d41-98c15cae7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume db117cd8-acc7-4eca-9cf2-2546d9f8ee58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58', 'volume_size': 1} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96" returned: 0 in 0.881s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7b347c-4ed0-4d2f-b97c-47d79604b3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f156a83bdb24619aa0eefcbe5d46993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:25Z,use_quota=True,user_id='21d21f2b3d654b77b99c7693df138189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03dfb8cc-00d4-4876-9148-c10b6dae9600),volume_type_id=03dfb8cc-00d4-4876-9148-c10b6dae9600)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Creating volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:29 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:29 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1073741824 Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e43e02-c6e7-4e58-8970-c9d540c5c436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e22017b-dfb1-476b-8901-8853c5a79b96', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b580b0c-5ef3-44fe-8202-74f1d12274da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:29 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-6e22017b-dfb1-476b-8901-8853c5a79b96 (6e22017b-dfb1-476b-8901-8853c5a79b96): created successfully Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b580b0c-5ef3-44fe-8202-74f1d12274da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (c7e0e877-5d34-4afe-9a81-f1c38f79e949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-72864530-de96-400a-9bf4-157a922e7151 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (efb0e13d-260b-40f5-bbf6-2a685a291c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a79f9f-ce20-49c1-9489-2c2562facdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a79f9f-ce20-49c1-9489-2c2562facdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048332736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0785139-110a-470a-b161-760ddb9b4361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:30Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd34ceb4-a38a-498a-8f4b-cc5595b452d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd34ceb4-a38a-498a-8f4b-cc5595b452d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864d1ad2-6f54-470e-bb09-f1bf698b5837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864d1ad2-6f54-470e-bb09-f1bf698b5837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0785139-110a-470a-b161-760ddb9b4361', 'volume_name': 'volume-c0785139-110a-470a-b161-760ddb9b4361', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c50ebd-1fdd-4161-bd2c-045132dca8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c50ebd-1fdd-4161-bd2c-045132dca8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca4a740-d721-4424-a9e9-bf0feeb8b943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:30 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume c0785139-110a-470a-b161-760ddb9b4361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0785139-110a-470a-b161-760ddb9b4361', 'volume_size': 1} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:30 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1073741824" returned: 0 in 0.745s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:30 devstack sudo[112811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 Aug 17 16:33:30 devstack sudo[112811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:30 devstack sudo[112811]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1937700590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cae453-25e2-4657-8972-8016c6ec49da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:28Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume f6cae453-25e2-4657-8972-8016c6ec49da {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:30 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:30 devstack sudo[112817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da 1073741824 Aug 17 16:33:30 devstack sudo[112817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Attempting download of 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}])) to volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c01b72-7e9d-45e8-8d6b-6a9e55fc0c0c]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:30 devstack sudo[112819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj Aug 17 16:33:30 devstack sudo[112819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:31 devstack sudo[112817]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da 1073741824" returned: 0 in 0.488s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:31 devstack sudo[112819]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:31 devstack sudo[112827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da Aug 17 16:33:31 devstack sudo[112827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:31 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj Aug 17 16:33:31 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:31 devstack sudo[112827]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926761441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3f66b36-80dd-4041-bec2-bff3321f2329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:29Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume a3f66b36-80dd-4041-bec2-bff3321f2329 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:31 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3806dfcb-0aa0-4c7b-b5f2-153469c73ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cae453-25e2-4657-8972-8016c6ec49da', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35834b1f-8ef6-4ef8-aee9-a0022605b8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:31 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:31 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 1073741824 Aug 17 16:33:31 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj" returned: 1 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_52bcvyaj' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f858d-865e-4ba6-bef4-6e103b7f6343]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-f6cae453-25e2-4657-8972-8016c6ec49da (f6cae453-25e2-4657-8972-8016c6ec49da): created successfully Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35834b1f-8ef6-4ef8-aee9-a0022605b8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (ec73ac79-f84d-4ba8-ab86-331697a4989d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1827286f-694c-4cd4-8578-3e3b2a9b6550 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:31 devstack sudo[112835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:31 devstack sudo[112835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:31 devstack sudo[112835]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:32 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 1073741824" returned: 0 in 0.480s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:32 devstack sudo[112843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 Aug 17 16:33:32 devstack sudo[112843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:32 devstack sudo[112842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD Aug 17 16:33:32 devstack sudo[112842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:32 devstack sudo[112843]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329" returned: 0 in 0.294s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:32 devstack sudo[112842]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-353123827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db117cd8-acc7-4eca-9cf2-2546d9f8ee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:29Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume db117cd8-acc7-4eca-9cf2-2546d9f8ee58 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:32 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 was raw, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:32 devstack sudo[112850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 1073741824 Aug 17 16:33:32 devstack sudo[112850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c73a7-6419-488a-ab8f-c08e88159979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3f66b36-80dd-4041-bec2-bff3321f2329', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2750070e-ed36-4bb7-9b98-6ca075b7e97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:32 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 Aug 17 16:33:32 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-a3f66b36-80dd-4041-bec2-bff3321f2329 (a3f66b36-80dd-4041-bec2-bff3321f2329): created successfully Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2750070e-ed36-4bb7-9b98-6ca075b7e97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (f43da983-63af-47bd-b74f-6ab1bfdd5099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-cd64fba5-8aa1-4c13-bb87-a48c93fe8741 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:32 devstack sudo[112850]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 1073741824" returned: 0 in 0.503s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:32 devstack sudo[112894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 Aug 17 16:33:32 devstack sudo[112894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:32 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" returned: 0 in 0.599s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:32 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530_5_gyp_nsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:33 devstack sudo[112896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1G Aug 17 16:33:33 devstack sudo[112896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:33 devstack sudo[112894]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" returned: 0 in 0.370s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.064s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048332736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0785139-110a-470a-b161-760ddb9b4361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e5508471346188c71808f571b41a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:30Z,use_quota=True,user_id='c9149823cb6741ffa1a95ff1cba207dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Creating volume c0785139-110a-470a-b161-760ddb9b4361 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf2c647-4a50-47d0-9d41-98c15cae7b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a253dff5-f24e-423e-92e1-67a5365b596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:33 devstack sudo[112896]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:33 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 1073741824 Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 1G" returned: 0 in 0.373s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Downloaded image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 ((None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}])) to volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Temporary image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 for user 21d21f2b3d654b77b99c7693df138189 is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Marking volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:33:33 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 (db117cd8-acc7-4eca-9cf2-2546d9f8ee58): created successfully Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a253dff5-f24e-423e-92e1-67a5365b596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (29f4769f-01ac-4f30-8620-bcede10ad0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Copying metadata from image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 to ae7b347c-4ed0-4d2f-b97c-47d79604b3b0. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Creating volume glance metadata for volume ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 backed by image 1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '470ae2f6727d9ebeb368417c359f28bb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8f6a1bee-8c8c-4674-bcc0-54995c1b6859 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eb10df6-faa3-4479-94fa-7411515fc471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0', 'volume_size': 1, 'image_id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '470ae2f6727d9ebeb368417c359f28bb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f156a83bdb24619aa0eefcbe5d46993', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe31ffbdced1542b311f18ae51828e24a8f8f493f82a6ff8e111fad32eee5a5895459d13da1e2c525b63fca2c3d6582020150c5168d66c61ed7719865a2e8043', 'id': '1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530', 'created_at': datetime.datetime(2026, 8, 17, 14, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 33, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f49bbc9-a9d4-4c9f-97eb-d0d7d4e15530/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510e4750-7c82-460b-b06d-e726b775b4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Volume volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 (ae7b347c-4ed0-4d2f-b97c-47d79604b3b0): created successfully Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510e4750-7c82-460b-b06d-e726b775b4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Flow 'volume_create_manager' (5ce86341-379c-48f8-a85d-54162d8f56b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5e1d6f25-37be-45cb-aeb2-a29f9a469fd2 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Created volume successfully. Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Acquiring lock "cinder-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "cinder-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:33 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 1073741824" returned: 0 in 0.569s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Acquiring lock "cinder-quobyte-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "cinder-quobyte-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:33 devstack sudo[112911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 Aug 17 16:33:33 devstack sudo[112911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4d1c02-1baf-48ff-9054-22f533e58ba6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:34 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 Aug 17 16:33:34 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:34 devstack sudo[112911]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361" returned: 0 in 0.267s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca4a740-d721-4424-a9e9-bf0feeb8b943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0785139-110a-470a-b161-760ddb9b4361', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a585dd-bae7-4e65-ab5b-9e6ed4cb4b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Volume volume-c0785139-110a-470a-b161-760ddb9b4361 (c0785139-110a-470a-b161-760ddb9b4361): created successfully Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a585dd-bae7-4e65-ab5b-9e6ed4cb4b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Flow 'volume_create_manager' (efb0e13d-260b-40f5-bbf6-2a685a291c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c9eb6175-e361-4f81-8493-6e211f8858ce tempest-CreateVolumesFromSnapshotTest-385202924 None] Created volume successfully. Aug 17 16:33:34 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:34 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0 Aug 17 16:33:34 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-c0785139-110a-470a-b161-760ddb9b4361-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-c0785139-110a-470a-b161-760ddb9b4361-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:34 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-c0785139-110a-470a-b161-760ddb9b4361" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "cinder-quobyte-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0" released by "delete_volume" :: held 0.726s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-c0785139-110a-470a-b161-760ddb9b4361" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d706afa-b07e-4a6f-9991-6452aba98479]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:34 devstack cinder-volume[94468]: WARNING cinder.quota [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:33:34 devstack cinder-volume[94468]: WARNING cinder.quota [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Created reservations ['a650f0fe-739a-477e-8960-9c30946c0fd0', 'ef48cc10-4de3-4557-bfb7-e611c61ff241', '5a1771d7-418a-4412-b65f-82766746f88a', '194442bc-936c-48db-b80f-497e7ffb26d0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:34 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 Aug 17 16:33:34 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:34 devstack sudo[112924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:34 devstack sudo[112924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:35 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361" returned: 0 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:35 devstack sudo[112924]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:35 devstack sudo[112931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361 Aug 17 16:33:35 devstack sudo[112931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Deleted volume successfully. Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-08577659-666d-4293-868c-f143f2162985 tempest-VolumeAndVolumeTypeFromImageTest-1308382929 None] Lock "cinder-ae7b347c-4ed0-4d2f-b97c-47d79604b3b0-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:35 devstack sudo[112931]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0785139-110a-470a-b161-760ddb9b4361" returned: 0 in 0.341s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-c0785139-110a-470a-b161-760ddb9b4361" released by "delete_volume" :: held 0.837s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['34b9b2f4-121d-408c-94b0-ac1c15f5e9a2', '8617ba95-b86e-4b09-ab29-695ede839fde', '617d00b8-3485-43c8-88e3-b583c244666a', '9df1c557-81d6-4ec9-95d7-e11701e70151'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:35 devstack sudo[112938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:35 devstack sudo[112938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-db117cd8-acc7-4eca-9cf2-2546d9f8ee58-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-db117cd8-acc7-4eca-9cf2-2546d9f8ee58-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:36 devstack sudo[112938]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3311f6ba-c2f9-4421-93b3-8f46d7e0809f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-6557d331-5bca-40fd-a68f-fb56195bf34f tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-c0785139-110a-470a-b161-760ddb9b4361-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:36 devstack sudo[112965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 Aug 17 16:33:36 devstack sudo[112965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:36 devstack sudo[112965]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" returned: 0 in 0.487s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:36 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58 Aug 17 16:33:36 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:36 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-db117cd8-acc7-4eca-9cf2-2546d9f8ee58" released by "delete_volume" :: held 0.865s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=90,cinder:UPDATE=84,cinder:INSERT=22,cinder:DELETE=5 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=76,cinder:UPDATE=84,cinder:INSERT=32,cinder:DELETE=11 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:33:36 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['7be7e0ca-2256-4501-8c27-122830efeacb', '3e849488-fdd2-48d4-8e9f-11064edcb3f6', 'aedf52e4-d675-4d5a-8627-3c6adef4d4ff', '47da6cbd-a4a3-4d39-993a-0dc5e4d4ae08'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:37 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:37 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:37 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.306s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c71e857c-c33c-437c-9462-8dd9ccf6b63a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-db117cd8-acc7-4eca-9cf2-2546d9f8ee58-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-a3f66b36-80dd-4041-bec2-bff3321f2329-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-a3f66b36-80dd-4041-bec2-bff3321f2329-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-a3f66b36-80dd-4041-bec2-bff3321f2329" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-a3f66b36-80dd-4041-bec2-bff3321f2329" acquired by "delete_volume" :: waited 0.014s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6bca39-3823-4986-8a3b-979d4fbbb1ff]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:38 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 Aug 17 16:33:38 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:38 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329" returned: 0 in 0.412s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:38 devstack sudo[112987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329 Aug 17 16:33:38 devstack sudo[112987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:38 devstack sudo[112987]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a3f66b36-80dd-4041-bec2-bff3321f2329" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-a3f66b36-80dd-4041-bec2-bff3321f2329" released by "delete_volume" :: held 0.720s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:38 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['a4b7b6d6-e293-4c94-bcb9-4c94870cd5c2', 'ca347b5e-e97c-4906-a0d5-5da247a82405', '77320d0e-45c8-447e-8de9-aea8fbd9115a', 'be29e13e-1b63-4edb-9a36-5536402f7ae9'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:39 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:39 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-f6cae453-25e2-4657-8972-8016c6ec49da-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-f6cae453-25e2-4657-8972-8016c6ec49da-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:39 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.320s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-f6cae453-25e2-4657-8972-8016c6ec49da" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-f6cae453-25e2-4657-8972-8016c6ec49da" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0112f3f-e617-4341-849b-a1df0a21f60a tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-a3f66b36-80dd-4041-bec2-bff3321f2329-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf6094-b746-4135-b756-5ce0e142b48e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:39 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da Aug 17 16:33:39 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:39 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:39 devstack sudo[112998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da Aug 17 16:33:39 devstack sudo[112998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:40 devstack sudo[112998]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f6cae453-25e2-4657-8972-8016c6ec49da" returned: 0 in 0.265s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-f6cae453-25e2-4657-8972-8016c6ec49da" released by "delete_volume" :: held 0.732s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['8c71bbe0-0821-4269-80d4-f6ab0cd899f0', '1d1677ad-32a7-4e06-b36c-ead00bdb82fd', 'b82b7a1a-7c9d-4f97-81c4-ab2982912818', '53f57452-535c-4325-862f-b7b2918098d6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (83710500-cf4f-4553-b314-837946f4c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139f26ff-5a28-439e-a904-ccdf531d5dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139f26ff-5a28-439e-a904-ccdf531d5dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588508010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19be1e6-b0c4-4e72-979a-d96098ca3e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:40Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5c8b0b-3d52-4302-9e56-4380f961847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5c8b0b-3d52-4302-9e56-4380f961847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f2ee40-def9-4f30-933a-cd94e0acd824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f2ee40-def9-4f30-933a-cd94e0acd824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19be1e6-b0c4-4e72-979a-d96098ca3e67', 'volume_name': 'volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0887a15b-4538-440b-a7bd-b6a9d2801a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0887a15b-4538-440b-a7bd-b6a9d2801a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b1b77-a2e5-4ed1-b479-c86417354517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Volume c19be1e6-b0c4-4e72-979a-d96098ca3e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67', 'volume_size': 1} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1588508010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19be1e6-b0c4-4e72-979a-d96098ca3e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:40Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Creating volume c19be1e6-b0c4-4e72-979a-d96098ca3e67 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:40 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:40 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 1073741824 Aug 17 16:33:40 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:40 devstack sudo[113003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:40 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-6e22017b-dfb1-476b-8901-8853c5a79b96-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-6e22017b-dfb1-476b-8901-8853c5a79b96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-6e22017b-dfb1-476b-8901-8853c5a79b96" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-6e22017b-dfb1-476b-8901-8853c5a79b96" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (297fce7f-d2ca-4743-ae17-49191c90c809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869ecb8d-8b67-4310-a155-328fe1e1fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e61a509-acfc-4bce-a9b8-60c944c891ad]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869ecb8d-8b67-4310-a155-328fe1e1fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753671687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b37538-bc41-4dd7-871c-cea575a8310c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:41Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046e1b8-440d-4f35-aa6c-3f1299d240fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8046e1b8-440d-4f35-aa6c-3f1299d240fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82f595b-7b4c-4ea6-9536-835ce9231546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82f595b-7b4c-4ea6-9536-835ce9231546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b37538-bc41-4dd7-871c-cea575a8310c', 'volume_name': 'volume-c1b37538-bc41-4dd7-871c-cea575a8310c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54168a7f-84db-4915-96aa-f0d7f1b295d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54168a7f-84db-4915-96aa-f0d7f1b295d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f64185d-582c-4b13-b534-89a653e93be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:40 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Volume c1b37538-bc41-4dd7-871c-cea575a8310c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b37538-bc41-4dd7-871c-cea575a8310c', 'volume_size': 1} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:40 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.432s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1958a112-58e7-47f9-ac15-60a240ef220e tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-f6cae453-25e2-4657-8972-8016c6ec49da-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:40 devstack sudo[113008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 Aug 17 16:33:40 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:40 devstack sudo[113008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 1073741824" returned: 0 in 0.641s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:41 devstack sudo[113012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 Aug 17 16:33:41 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (032157bf-ffb2-4873-b627-0b93dd1d9b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dcd2aa-d84e-4539-b0fd-d5aecc8c4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85dcd2aa-d84e-4539-b0fd-d5aecc8c4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1451077227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73f2522-73a3-4b89-b7b8-d8769180c84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:41Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f822592-4467-4b6b-9646-32318f61e84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f822592-4467-4b6b-9646-32318f61e84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb4dcc7-2765-41c5-9116-e6c817bba5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb4dcc7-2765-41c5-9116-e6c817bba5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a73f2522-73a3-4b89-b7b8-d8769180c84d', 'volume_name': 'volume-a73f2522-73a3-4b89-b7b8-d8769180c84d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35bd025-a60c-4b84-9105-3e19e538d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35bd025-a60c-4b84-9105-3e19e538d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe339ae1-9613-4fb7-8488-1d8021b15614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Volume a73f2522-73a3-4b89-b7b8-d8769180c84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a73f2522-73a3-4b89-b7b8-d8769180c84d', 'volume_size': 1} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:41 devstack sudo[113008]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96" returned: 0 in 0.528s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:41 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67" returned: 0 in 0.305s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:41 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96 Aug 17 16:33:41 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753671687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b37538-bc41-4dd7-871c-cea575a8310c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:41Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Creating volume c1b37538-bc41-4dd7-871c-cea575a8310c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:41 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b1b77-a2e5-4ed1-b479-c86417354517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31481df2-7ddc-44a3-bac7-d1c6f69e0493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack sudo[113020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c 1073741824 Aug 17 16:33:41 devstack sudo[113020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Volume volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 (c19be1e6-b0c4-4e72-979a-d96098ca3e67): created successfully Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31481df2-7ddc-44a3-bac7-d1c6f69e0493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (83710500-cf4f-4553-b314-837946f4c210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bcf984f4-a4d5-4def-991d-3556aa551c82 tempest-CreateVolumesFromImageTest-63976269 None] Created volume successfully. Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:41 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (f2cc6797-4aed-421a-b22c-2a32a63fb243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb36f49-fbc4-49e5-9a26-3586585bc34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e22017b-dfb1-476b-8901-8853c5a79b96" returned: 0 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb36f49-fbc4-49e5-9a26-3586585bc34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1698571320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c3d38c-c027-41c5-81ed-60f92a25d658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:42Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b79b16-6b0e-43e8-bec6-add7a263f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b79b16-6b0e-43e8-bec6-add7a263f43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3ba014-a8ff-44a0-82f3-266cab54f436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3ba014-a8ff-44a0-82f3-266cab54f436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c3d38c-c027-41c5-81ed-60f92a25d658', 'volume_name': 'volume-c0c3d38c-c027-41c5-81ed-60f92a25d658', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e70f7a-fa97-46d7-9f4c-94b340872998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e70f7a-fa97-46d7-9f4c-94b340872998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541aa7ad-5730-485b-9d25-0ac2a3ebfd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Volume c0c3d38c-c027-41c5-81ed-60f92a25d658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c3d38c-c027-41c5-81ed-60f92a25d658', 'volume_size': 1} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-6e22017b-dfb1-476b-8901-8853c5a79b96" released by "delete_volume" :: held 1.137s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['4ff385b1-0453-4325-9072-26653e2fddc3', '23fa4033-6601-4867-9291-30caf037b779', 'bd93b902-8149-41d5-9bf2-012c8319a8f0', '12d0c611-2d77-4374-875c-776060b8164f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:41 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:41 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:42 devstack sudo[113020]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c 1073741824" returned: 0 in 0.693s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (5c53413e-946d-4bad-ae52-f86ca74f3a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4ab4c-72a5-4582-9d75-1a3848bfaea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a4ab4c-72a5-4582-9d75-1a3848bfaea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-348980230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3e687-6427-474d-bb6f-a88ba1963c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:42Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaa628d-ed21-4090-b534-62a8750225a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaa628d-ed21-4090-b534-62a8750225a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack sudo[113029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c Aug 17 16:33:42 devstack sudo[113029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c86b62-378e-46c6-a8c8-59b117ffb830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c86b62-378e-46c6-a8c8-59b117ffb830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab3e687-6427-474d-bb6f-a88ba1963c40', 'volume_name': 'volume-4ab3e687-6427-474d-bb6f-a88ba1963c40', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77455e3b-c967-468d-a656-6f3a686cbdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77455e3b-c967-468d-a656-6f3a686cbdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66200ba-4915-4db6-9f14-e67befb9d08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Volume 4ab3e687-6427-474d-bb6f-a88ba1963c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab3e687-6427-474d-bb6f-a88ba1963c40', 'volume_size': 1} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:42 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.264s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8f96d746-d9d2-4853-9e70-05fe24c186f8 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-6e22017b-dfb1-476b-8901-8853c5a79b96-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:42 devstack sudo[113029]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1451077227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a73f2522-73a3-4b89-b7b8-d8769180c84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:41Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Creating volume a73f2522-73a3-4b89-b7b8-d8769180c84d {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:42 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f64185d-582c-4b13-b534-89a653e93be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b37538-bc41-4dd7-871c-cea575a8310c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack sudo[113033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d 1073741824 Aug 17 16:33:42 devstack sudo[113033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c98f59-ff2f-405f-8be5-1c14c15c737e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Volume volume-c1b37538-bc41-4dd7-871c-cea575a8310c (c1b37538-bc41-4dd7-871c-cea575a8310c): created successfully Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c98f59-ff2f-405f-8be5-1c14c15c737e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (297fce7f-d2ca-4743-ae17-49191c90c809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-20aed2c0-9d30-4061-9bc7-dc432b587d4c tempest-CreateVolumesFromImageTest-63976269 None] Created volume successfully. Aug 17 16:33:42 devstack sudo[113033]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d 1073741824" returned: 0 in 0.429s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-78abec3c-30e7-42c7-95ef-f83cb38e8c6c-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-78abec3c-30e7-42c7-95ef-f83cb38e8c6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-78abec3c-30e7-42c7-95ef-f83cb38e8c6c" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:42 devstack sudo[113039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d Aug 17 16:33:42 devstack sudo[113039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-78abec3c-30e7-42c7-95ef-f83cb38e8c6c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleting offline snapshot 78abec3c-30e7-42c7-95ef-f83cb38e8c6c of volume fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] snapshot_file for this snap is: volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7647a3-1233-4754-87cc-3f821a91e08d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:43 devstack sudo[113041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c Aug 17 16:33:43 devstack sudo[113041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:43 devstack sudo[113039]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d" returned: 0 in 0.298s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.384s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1698571320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c3d38c-c027-41c5-81ed-60f92a25d658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:42Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Creating volume c0c3d38c-c027-41c5-81ed-60f92a25d658 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:43 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe339ae1-9613-4fb7-8488-1d8021b15614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a73f2522-73a3-4b89-b7b8-d8769180c84d', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5afaf-99a2-4ef1-bad7-a67df330f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:43 devstack sudo[113044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 1073741824 Aug 17 16:33:43 devstack sudo[113044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:43 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Volume volume-a73f2522-73a3-4b89-b7b8-d8769180c84d (a73f2522-73a3-4b89-b7b8-d8769180c84d): created successfully Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f5afaf-99a2-4ef1-bad7-a67df330f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (032157bf-ffb2-4873-b627-0b93dd1d9b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ce86d241-6379-4460-84c7-d26f6d297349 tempest-CreateVolumesFromImageTest-63976269 None] Created volume successfully. Aug 17 16:33:43 devstack sudo[113041]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c" returned: 0 in 0.387s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe98c646-7e98-4d2c-9f03-768cee344da2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[acda9d5d-d158-4e4f-8d38-ec8447e5ad41]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:43 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 Aug 17 16:33:43 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:43 devstack sudo[113044]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 1073741824" returned: 0 in 0.445s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:43 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 Aug 17 16:33:43 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:43 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2" returned: 0 in 0.416s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:43 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c Aug 17 16:33:43 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:43 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658" returned: 0 in 0.294s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-348980230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3e687-6427-474d-bb6f-a88ba1963c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc0790f4b4a469a8fa2f9da69e71518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:42Z,use_quota=True,user_id='1924be33634a4963bdfd118304d640ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Creating volume 4ab3e687-6427-474d-bb6f-a88ba1963c40 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:44 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541aa7ad-5730-485b-9d25-0ac2a3ebfd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c3d38c-c027-41c5-81ed-60f92a25d658', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:44 devstack sudo[113065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 1073741824 Aug 17 16:33:44 devstack sudo[113065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6160615d-729e-4c20-b055-1a062cd39f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:44 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Volume volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 (c0c3d38c-c027-41c5-81ed-60f92a25d658): created successfully Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6160615d-729e-4c20-b055-1a062cd39f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (f2cc6797-4aed-421a-b22c-2a32a63fb243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c8b3628e-28d5-4388-8704-5f5f396ef0e0 tempest-CreateVolumesFromImageTest-63976269 None] Created volume successfully. Aug 17 16:33:44 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c" returned: 0 in 0.393s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:44 devstack sudo[113068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c Aug 17 16:33:44 devstack sudo[113068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:44 devstack sudo[113068]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2.78abec3c-30e7-42c7-95ef-f83cb38e8c6c" returned: 0 in 0.337s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-78abec3c-30e7-42c7-95ef-f83cb38e8c6c" released by "_delete_snapshot" :: held 1.643s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" released by "delete_snapshot" :: held 1.670s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:44 devstack sudo[113065]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 1073741824" returned: 0 in 0.569s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:44 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 Aug 17 16:33:44 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['67d1e70e-6e0a-492c-af2a-a7132214f0e6', '45df435d-e61d-483b-9ab7-7b3473a86e1b', 'ed1afde2-2c85-4b97-8aa2-7427841e91ea', 'c65893cc-b13b-48a6-9b55-2eafc29a1519'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Delete snapshot completed successfully. Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3c9e4c19-0c21-4661-9de7-0ad153250b8c tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-78abec3c-30e7-42c7-95ef-f83cb38e8c6c-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:44 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40" returned: 0 in 0.320s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66200ba-4915-4db6-9f14-e67befb9d08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab3e687-6427-474d-bb6f-a88ba1963c40', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52585f93-16f9-4066-a7dd-2bde03bc0e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:45 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Volume volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 (4ab3e687-6427-474d-bb6f-a88ba1963c40): created successfully Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52585f93-16f9-4066-a7dd-2bde03bc0e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Flow 'volume_create_manager' (5c53413e-946d-4bad-ae52-f86ca74f3a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-fe98c646-7e98-4d2c-9f03-768cee344da2-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-71665771-eaf0-4243-81ba-65dbeefaad0c tempest-CreateVolumesFromImageTest-63976269 None] Created volume successfully. Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-fe98c646-7e98-4d2c-9f03-768cee344da2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[08230770-b963-4c3f-9cbb-41bf67655279]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:45 devstack sudo[113078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 Aug 17 16:33:45 devstack sudo[113078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-4ab3e687-6427-474d-bb6f-a88ba1963c40-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-4ab3e687-6427-474d-bb6f-a88ba1963c40-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-quobyte-4ab3e687-6427-474d-bb6f-a88ba1963c40" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-4ab3e687-6427-474d-bb6f-a88ba1963c40" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3caf83-149e-4393-af7f-de79705d35e2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:45 devstack sudo[113078]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2" returned: 0 in 0.483s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:45 devstack sudo[113084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2 Aug 17 16:33:45 devstack sudo[113084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:45 devstack sudo[113083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 Aug 17 16:33:45 devstack sudo[113083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:45 devstack sudo[113084]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fe98c646-7e98-4d2c-9f03-768cee344da2" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-quobyte-fe98c646-7e98-4d2c-9f03-768cee344da2" released by "delete_volume" :: held 0.851s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Created reservations ['4ea36429-8f53-4366-bd35-014404bfb8a2', '896fd8ca-edaa-4749-8e57-1b4d3424188c', '44e36422-e2b9-4268-9cff-87c7ee9adea9', '74cb4f98-d349-4f75-ab70-48ee324fbd31'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:46 devstack sudo[113083]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40" returned: 0 in 0.435s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:46 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40 Aug 17 16:33:46 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:46 devstack sudo[113093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:46 devstack sudo[113093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:46 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ab3e687-6427-474d-bb6f-a88ba1963c40" returned: 0 in 0.312s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-4ab3e687-6427-474d-bb6f-a88ba1963c40" released by "delete_volume" :: held 0.799s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:46 devstack sudo[113093]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Deleted volume successfully. Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Created reservations ['56727992-a064-43e4-9edc-c2c7aaa8fc8f', 'd37ca742-d9f1-4133-afb4-6306efff4879', 'd134a2c4-a4ee-45f9-9f2a-3925d5926370', '289f3407-8cc1-45fd-9a11-d876d1106445'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f91e08c6-2754-45f1-9837-34562285de74 tempest-CreateVolumesFromSnapshotTest-385202924 None] Lock "cinder-fe98c646-7e98-4d2c-9f03-768cee344da2-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:46 devstack sudo[113106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:46 devstack sudo[113106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-c0c3d38c-c027-41c5-81ed-60f92a25d658-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c0c3d38c-c027-41c5-81ed-60f92a25d658-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:46 devstack sudo[113108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:46 devstack sudo[113108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-quobyte-c0c3d38c-c027-41c5-81ed-60f92a25d658" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c0c3d38c-c027-41c5-81ed-60f92a25d658" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e16c9-2a36-4d0b-99b6-645d0a0b58fd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:47 devstack sudo[113106]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.421s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Deleted volume successfully. Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-799ec84c-2748-4281-91c3-5cc629b0fc8e tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-4ab3e687-6427-474d-bb6f-a88ba1963c40-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:47 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 Aug 17 16:33:47 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:47 devstack sudo[113108]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.360s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:33:47 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658" returned: 0 in 0.511s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:47 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658 Aug 17 16:33:47 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:47 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c0c3d38c-c027-41c5-81ed-60f92a25d658" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c0c3d38c-c027-41c5-81ed-60f92a25d658" released by "delete_volume" :: held 0.856s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Created reservations ['b12f3351-5948-4e41-96cd-d0c6bdc6fdc3', '73de8003-dcf3-4e6b-bf72-d6684f013810', '738f5457-ef2f-48f8-924b-bcfbc8be0058', 'ad90694f-69c8-43c9-8d37-38c467632067'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:47 devstack sudo[113120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:47 devstack sudo[113120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-a73f2522-73a3-4b89-b7b8-d8769180c84d-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-a73f2522-73a3-4b89-b7b8-d8769180c84d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-quobyte-a73f2522-73a3-4b89-b7b8-d8769180c84d" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-a73f2522-73a3-4b89-b7b8-d8769180c84d" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8060f-3653-4d20-9ff2-1f260f832167]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:48 devstack sudo[113120]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Deleted volume successfully. Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-faf0d8d0-7d07-474f-bebf-00db4fec53eb tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c0c3d38c-c027-41c5-81ed-60f92a25d658-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:48 devstack sudo[113122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d Aug 17 16:33:48 devstack sudo[113122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:48 devstack sudo[113122]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d" returned: 0 in 0.406s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:48 devstack sudo[113128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d Aug 17 16:33:48 devstack sudo[113128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:48 devstack sudo[113128]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a73f2522-73a3-4b89-b7b8-d8769180c84d" returned: 0 in 0.264s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-a73f2522-73a3-4b89-b7b8-d8769180c84d" released by "delete_volume" :: held 0.730s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Created reservations ['eeeff07d-94bd-49f0-bffd-942df9fb2f54', 'c42b3ddc-52eb-4051-8bac-cd324b08221b', 'd03d0d9d-7c6b-4909-8f1f-b74159bf8c9a', '63398693-9e9d-49a1-97a6-9df7195c0730'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:48 devstack sudo[113131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:48 devstack sudo[113131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-c1b37538-bc41-4dd7-871c-cea575a8310c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c1b37538-bc41-4dd7-871c-cea575a8310c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:49 devstack sudo[113131]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.286s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Deleted volume successfully. Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b6b0202c-58f4-4d4c-a62e-b08aec0d5d81 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-a73f2522-73a3-4b89-b7b8-d8769180c84d-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-quobyte-c1b37538-bc41-4dd7-871c-cea575a8310c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c1b37538-bc41-4dd7-871c-cea575a8310c" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6734e222-49e9-46e6-a9ff-bbd0a53526d1]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:49 devstack sudo[113134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c Aug 17 16:33:49 devstack sudo[113134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:49 devstack sudo[113134]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c" returned: 0 in 0.408s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:49 devstack sudo[113139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c Aug 17 16:33:49 devstack sudo[113139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Flow 'volume_create_manager' (be6fc56a-3a43-4148-bf8a-340c6037161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec54f4b-150f-4c78-803d-f52f2da104c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec54f4b-150f-4c78-803d-f52f2da104c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fe00fe-6267-48b2-b03b-2439a34637dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd8adf34a04acc842521946016bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:50Z,use_quota=True,user_id='97d6a1517f1647b6af44c44b4b443cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be21ea3-03d1-494c-b9ae-41892dd564fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be21ea3-03d1-494c-b9ae-41892dd564fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d403e7-1dec-443c-95fc-c8853ffa846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d403e7-1dec-443c-95fc-c8853ffa846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fe00fe-6267-48b2-b03b-2439a34637dd', 'volume_name': 'volume-e8fe00fe-6267-48b2-b03b-2439a34637dd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a40284-e466-4490-b031-1e6b4151f2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a40284-e466-4490-b031-1e6b4151f2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb68e2b5-384d-4593-94dd-634a19ab2c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Volume e8fe00fe-6267-48b2-b03b-2439a34637dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fe00fe-6267-48b2-b03b-2439a34637dd', 'volume_size': 1} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fe00fe-6267-48b2-b03b-2439a34637dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd8adf34a04acc842521946016bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:50Z,use_quota=True,user_id='97d6a1517f1647b6af44c44b4b443cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Creating volume e8fe00fe-6267-48b2-b03b-2439a34637dd {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:49 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:49 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd 1073741824 Aug 17 16:33:49 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:50 devstack sudo[113139]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c1b37538-bc41-4dd7-871c-cea575a8310c" returned: 0 in 0.288s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c1b37538-bc41-4dd7-871c-cea575a8310c" released by "delete_volume" :: held 0.743s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Created reservations ['bd13bf78-b3c3-4f58-8123-e3d58247bc21', '222de58f-6f05-4724-9d88-dec5f4c10626', 'b6cbe022-5990-40f8-9c18-22c9d893ecd4', '63dab2c8-df3a-4b53-b9b3-49108cb0d58a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:50 devstack sudo[113150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:50 devstack sudo[113150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-c19be1e6-b0c4-4e72-979a-d96098ca3e67-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c19be1e6-b0c4-4e72-979a-d96098ca3e67-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "cinder-quobyte-c19be1e6-b0c4-4e72-979a-d96098ca3e67" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c19be1e6-b0c4-4e72-979a-d96098ca3e67" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eb0f7e-12e0-4b1b-9248-8014fe669989]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:50 devstack sudo[113150]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:50 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd 1073741824" returned: 0 in 0.599s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Deleted volume successfully. Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5bb6779-b448-4554-a986-c0d1477084a9 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c1b37538-bc41-4dd7-871c-cea575a8310c-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:50 devstack sudo[113159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd Aug 17 16:33:50 devstack sudo[113159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:50 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 Aug 17 16:33:50 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:50 devstack sudo[113159]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb68e2b5-384d-4593-94dd-634a19ab2c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fe00fe-6267-48b2-b03b-2439a34637dd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d009ed76-04e6-484e-8945-349e2074a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-dbc2b1e2-a7ac-4120-b2b2-662222b4ee78 req-18601766-bfa4-4113-9c47-88fd4a1663c9 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-dbc2b1e2-a7ac-4120-b2b2-662222b4ee78 req-18601766-bfa4-4113-9c47-88fd4a1663c9 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-dbc2b1e2-a7ac-4120-b2b2-662222b4ee78 req-18601766-bfa4-4113-9c47-88fd4a1663c9 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:50 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Volume volume-e8fe00fe-6267-48b2-b03b-2439a34637dd (e8fe00fe-6267-48b2-b03b-2439a34637dd): created successfully Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d009ed76-04e6-484e-8945-349e2074a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Flow 'volume_create_manager' (be6fc56a-3a43-4148-bf8a-340c6037161d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-be39a33b-df4e-47cb-9dda-10c34c244cfb tempest-CinderUnicodeTest-392256304 None] Created volume successfully. Aug 17 16:33:50 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67" returned: 0 in 0.484s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-dbc2b1e2-a7ac-4120-b2b2-662222b4ee78 req-18601766-bfa4-4113-9c47-88fd4a1663c9 tempest-TestInstancesWithCinderVolumes-540805210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a13913b6-c2ca-444b-ae6f-db321e3a4563', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:33:51 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67 Aug 17 16:33:51 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-dbc2b1e2-a7ac-4120-b2b2-662222b4ee78 req-18601766-bfa4-4113-9c47-88fd4a1663c9 tempest-TestInstancesWithCinderVolumes-540805210 None] attachment_update completed successfully. Aug 17 16:33:51 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c19be1e6-b0c4-4e72-979a-d96098ca3e67" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-quobyte-c19be1e6-b0c4-4e72-979a-d96098ca3e67" released by "delete_volume" :: held 0.818s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Created reservations ['f9c96463-b099-4dca-a081-dd5e9a4d57e3', '89f11192-eb77-4f4e-993b-ae38f42f6b36', 'fca134c3-b4d4-4efa-a326-c419240483fd', 'dadd5ffa-6cd3-4741-8295-271cdcd12f4d'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:51 devstack sudo[113182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:33:51 devstack sudo[113182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:51 devstack sudo[113182]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:33:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Deleted volume successfully. Aug 17 16:33:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d486a3ba-91a5-4b31-ba1e-d99744e0a1a8 tempest-CreateVolumesFromImageTest-63976269 None] Lock "cinder-c19be1e6-b0c4-4e72-979a-d96098ca3e67-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Flow 'volume_create_manager' (be36959e-3a9e-4c4d-9c15-87d8be693ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d85a10-ab23-436f-993c-70146e9b315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d85a10-ab23-436f-993c-70146e9b315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-686176823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a502ba1-12a4-446d-ba77-96a1acbd90b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd8adf34a04acc842521946016bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:52Z,use_quota=True,user_id='97d6a1517f1647b6af44c44b4b443cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c1a759-41c0-45d5-861f-e278b5956f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c1a759-41c0-45d5-861f-e278b5956f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ceab11-2b1e-4be2-a94c-d95c301a7244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ceab11-2b1e-4be2-a94c-d95c301a7244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a502ba1-12a4-446d-ba77-96a1acbd90b3', 'volume_name': 'volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29413b0f-67fa-48ce-8fc8-47529895bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29413b0f-67fa-48ce-8fc8-47529895bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bac7e6-767d-49c1-81c1-8a705fa27b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:52 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Volume 4a502ba1-12a4-446d-ba77-96a1acbd90b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3', 'volume_size': 1} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:33:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-686176823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a502ba1-12a4-446d-ba77-96a1acbd90b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdd8adf34a04acc842521946016bd10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:33:52Z,use_quota=True,user_id='97d6a1517f1647b6af44c44b4b443cec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Creating volume 4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:33:52 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:33:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:52 devstack sudo[113185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 1073741824 Aug 17 16:33:52 devstack sudo[113185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:53 devstack sudo[113185]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 1073741824" returned: 0 in 0.566s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:53 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 Aug 17 16:33:53 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:53 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43bac7e6-767d-49c1-81c1-8a705fa27b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ecfef2-8056-45f9-8996-6d1f400d9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:33:53 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Volume volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 (4a502ba1-12a4-446d-ba77-96a1acbd90b3): created successfully Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ecfef2-8056-45f9-8996-6d1f400d9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:33:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Flow 'volume_create_manager' (be36959e-3a9e-4c4d-9c15-87d8be693ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:33:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3cacaaf8-1024-4b6f-a4dc-73ddc740266f tempest-CinderUnicodeTest-392256304 None] Created volume successfully. Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d636ad11-6d77-440c-a3ad-60ecf21c8478 req-12dc3927-8955-450e-b932-93e7854e394c tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d636ad11-6d77-440c-a3ad-60ecf21c8478 req-12dc3927-8955-450e-b932-93e7854e394c tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [req-d636ad11-6d77-440c-a3ad-60ecf21c8478 req-12dc3927-8955-450e-b932-93e7854e394c tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-d636ad11-6d77-440c-a3ad-60ecf21c8478 req-12dc3927-8955-450e-b932-93e7854e394c tempest-TestInstancesWithCinderVolumes-540805210 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3', 'name': 'volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7a4f480-09bf-4802-9544-e76da58b02c8', 'enforce_multipath': True} {{(pid=94468) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 17 16:33:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-d636ad11-6d77-440c-a3ad-60ecf21c8478 req-12dc3927-8955-450e-b932-93e7854e394c tempest-TestInstancesWithCinderVolumes-540805210 None] attachment_update completed successfully. Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Creating offline snapshot 5a203666-0683-4825-80ed-c6c9c59a8011 of volume 4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd0d7ba-257a-4234-93e7-74fed4a22f37]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:55 devstack sudo[113217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 Aug 17 16:33:55 devstack sudo[113217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:55 devstack sudo[113217]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3" returned: 0 in 0.441s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:55 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 1G Aug 17 16:33:55 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:55 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 1G" returned: 0 in 0.506s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:55 devstack sudo[113233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 Aug 17 16:33:55 devstack sudo[113233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:56 devstack sudo[113233]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011" returned: 0 in 0.341s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:56 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 is being set with open permissions: ugo+rw Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:56 devstack sudo[113239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 Aug 17 16:33:56 devstack sudo[113239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:56 devstack sudo[113239]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:56 devstack sudo[113242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info Aug 17 16:33:56 devstack sudo[113242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:56 devstack sudo[113242]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:56 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info is being set with open permissions: ugo+rw Aug 17 16:33:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:56 devstack sudo[113249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info Aug 17 16:33:56 devstack sudo[113249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:57 devstack sudo[113249]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.info" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:33:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c6c7e782-87d3-4223-a20c-b3cab5edd33b tempest-CinderUnicodeTest-392256304 None] Create snapshot completed successfully Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-5a203666-0683-4825-80ed-c6c9c59a8011-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-5a203666-0683-4825-80ed-c6c9c59a8011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-quobyte-5a203666-0683-4825-80ed-c6c9c59a8011" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-5a203666-0683-4825-80ed-c6c9c59a8011" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Deleting offline snapshot 5a203666-0683-4825-80ed-c6c9c59a8011 of volume 4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] snapshot_file for this snap is: volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2422184c-5b24-45d9-8992-bbb58d1e3b08]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:58 devstack sudo[113256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 Aug 17 16:33:58 devstack sudo[113256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:58 devstack sudo[113256]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011" returned: 0 in 0.501s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95509e-1cd2-461b-8fcc-55f548adfdb4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:33:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:58 devstack sudo[113261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 Aug 17 16:33:58 devstack sudo[113261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:59 devstack sudo[113261]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3" returned: 0 in 0.424s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:59 devstack sudo[113270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 Aug 17 16:33:59 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:59 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011" returned: 0 in 0.402s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:33:59 devstack sudo[113283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011 Aug 17 16:33:59 devstack sudo[113283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:33:59 devstack sudo[113283]: pam_unix(sudo:session): session closed for user root Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3.5a203666-0683-4825-80ed-c6c9c59a8011" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-5a203666-0683-4825-80ed-c6c9c59a8011" released by "_delete_snapshot" :: held 1.748s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" released by "delete_snapshot" :: held 1.775s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:33:59 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Created reservations ['4f6545b3-71f7-45a6-8988-acbabcccba74', '89f738e3-d20d-4070-803a-cd01301ac013', '7a08eb3b-de63-4a9f-b036-b3e76f4daabf', '54f65c34-0587-4900-b9e9-3bda5d32c5c1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:00 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Delete snapshot completed successfully. Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0a14eb49-580e-47da-81f0-15033d0f8ada tempest-CinderUnicodeTest-392256304 None] Lock "cinder-5a203666-0683-4825-80ed-c6c9c59a8011-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-4a502ba1-12a4-446d-ba77-96a1acbd90b3-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-4a502ba1-12a4-446d-ba77-96a1acbd90b3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e4616-4224-4326-9d2d-ca19c6c9a2c8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:00 devstack sudo[113298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 Aug 17 16:34:00 devstack sudo[113298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:00 devstack sudo[113298]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3" returned: 0 in 0.484s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:00 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3 Aug 17 16:34:00 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:01 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4a502ba1-12a4-446d-ba77-96a1acbd90b3" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-4a502ba1-12a4-446d-ba77-96a1acbd90b3" released by "delete_volume" :: held 0.888s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a07de218-98b8-4e1d-9e8e-6141fe1b6405 req-a5b30a38-0eda-4d6f-aa2e-179c0fd261c4 tempest-TestInstancesWithCinderVolumes-540805210 None] Terminate volume connection completed successfully. Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a07de218-98b8-4e1d-9e8e-6141fe1b6405 req-a5b30a38-0eda-4d6f-aa2e-179c0fd261c4 tempest-TestInstancesWithCinderVolumes-540805210 None] Deleting attachment a13913b6-c2ca-444b-ae6f-db321e3a4563. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Created reservations ['3bf7a89c-eda5-41f8-b238-a70da635030b', 'c5717ae0-4545-4c81-ace6-6c764feef798', '7aff5058-7716-477f-8584-5279f8b46a06', '5518ca22-cfe4-4e04-ab2c-652d3175275f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:01 devstack sudo[113311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:01 devstack sudo[113311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-e8fe00fe-6267-48b2-b03b-2439a34637dd-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-e8fe00fe-6267-48b2-b03b-2439a34637dd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "cinder-quobyte-e8fe00fe-6267-48b2-b03b-2439a34637dd" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-e8fe00fe-6267-48b2-b03b-2439a34637dd" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ece4f7-d6de-45e8-82f9-ca2990ad185a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:01 devstack sudo[113311]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.352s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Deleted volume successfully. Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e6652430-fcec-4091-801f-e8956d7669e2 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-4a502ba1-12a4-446d-ba77-96a1acbd90b3-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-c03bc927-0d6d-4fb5-8046-3c19a07d19a3-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:01 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd Aug 17 16:34:01 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-c03bc927-0d6d-4fb5-8046-3c19a07d19a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-quobyte-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c861a637-46ad-4b4d-b37e-4e7dbdb5ef18]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:02 devstack sudo[113320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 Aug 17 16:34:02 devstack sudo[113320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:02 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd" returned: 0 in 0.515s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:02 devstack sudo[113325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd Aug 17 16:34:02 devstack sudo[113325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:02 devstack sudo[113320]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" returned: 0 in 0.472s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:02 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3 Aug 17 16:34:02 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:02 devstack sudo[113325]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e8fe00fe-6267-48b2-b03b-2439a34637dd" returned: 0 in 0.337s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-quobyte-e8fe00fe-6267-48b2-b03b-2439a34637dd" released by "delete_volume" :: held 0.926s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Created reservations ['5362abe3-8a28-4dfd-9361-927d7f3c0cd0', 'f67dbf98-2f19-42b7-ba97-60ab1ea2b175', '45e26e20-4729-4c13-a85d-159dda9a1fab', '0479473d-6e0a-4a2f-9e5d-76af96a9f0ca'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:02 devstack sudo[113334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:02 devstack sudo[113334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:02 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" returned: 0 in 0.385s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-c03bc927-0d6d-4fb5-8046-3c19a07d19a3" released by "delete_volume" :: held 0.935s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:02 devstack cinder-volume[94468]: WARNING cinder.quota [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-711416339-1458375774 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-711416339-1458375774, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:02 devstack cinder-volume[94468]: WARNING cinder.quota [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-711416339-1458375774 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-711416339-1458375774, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Created reservations ['2bd16a43-adf3-44f5-802b-c1cc202dc134', '92fd09eb-ec41-4db2-95a2-c97a33074209', '3c1fe25d-5abf-490c-a1f6-4a35132e70d3', 'c3fdac07-4adc-4924-a205-6538b237550e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:03 devstack sudo[113336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:03 devstack sudo[113336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:03 devstack sudo[113334]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.481s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Deleted volume successfully. Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-80f53348-1531-47eb-b08b-cc99c45f9ee3 tempest-CinderUnicodeTest-392256304 None] Lock "cinder-e8fe00fe-6267-48b2-b03b-2439a34637dd-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:03 devstack sudo[113336]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.331s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Deleted volume successfully. Aug 17 16:34:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-578ee449-8ad4-4fd1-9ad2-2cda5a5d38f7 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-c03bc927-0d6d-4fb5-8046-3c19a07d19a3-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-26ff8ac4-6ff5-438a-9c2b-eb8afc4b6690 req-057491b3-8920-4987-8be6-70f7ff67cc01 tempest-TestInstancesWithCinderVolumes-540805210 None] Terminate volume connection completed successfully. Aug 17 16:34:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-26ff8ac4-6ff5-438a-9c2b-eb8afc4b6690 req-057491b3-8920-4987-8be6-70f7ff67cc01 tempest-TestInstancesWithCinderVolumes-540805210 None] Deleting attachment a7a4f480-09bf-4802-9544-e76da58b02c8. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-80c9ab51-23b1-4c55-bf08-4db66d8d16dc-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-80c9ab51-23b1-4c55-bf08-4db66d8d16dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-quobyte-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f21363-b1e8-495f-8f12-aa823b63b733]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:07 devstack sudo[113366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc Aug 17 16:34:07 devstack sudo[113366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:08 devstack sudo[113366]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" returned: 0 in 0.659s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:08 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc Aug 17 16:34:08 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:08 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-80c9ab51-23b1-4c55-bf08-4db66d8d16dc" released by "delete_volume" :: held 1.083s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:08 devstack cinder-volume[94468]: WARNING cinder.quota [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855104080-1345777962 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855104080-1345777962, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:08 devstack cinder-volume[94468]: WARNING cinder.quota [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855104080-1345777962 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-855104080-1345777962, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Created reservations ['1c9cff77-c6a0-46f5-a3cc-e8c1f0530f8d', 'eb9fd1f2-e147-4d0c-80fd-a66291c7db09', '5c85aec4-b2b7-4416-98ce-5150f3c44bf7', '65a9e2e2-814b-48b0-a3e1-f3c4d2bb6136'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:08 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:08 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:09 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:09 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:09 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Deleted volume successfully. Aug 17 16:34:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-635054ce-bad8-48fa-95a4-138e96c18f74 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-80c9ab51-23b1-4c55-bf08-4db66d8d16dc-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (f988fbe0-6a03-4691-a121-dabd3cd39a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e3350a-7b3f-4877-992e-41e6e43fa656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e3350a-7b3f-4877-992e-41e6e43fa656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267468767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2d16f-0e7f-43a8-9503-59a2676095a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:15Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad1ae8-0b94-458f-bdca-b602497aa814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecad1ae8-0b94-458f-bdca-b602497aa814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c5e61e-c72e-460a-875d-d961ca68246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c5e61e-c72e-460a-875d-d961ca68246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f2d16f-0e7f-43a8-9503-59a2676095a2', 'volume_name': 'volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b8b329-c91a-4ade-bb6c-4000f03dc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b8b329-c91a-4ade-bb6c-4000f03dc71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dd5f8e-0ed7-4844-875a-5c392b43f8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:15 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Volume d0f2d16f-0e7f-43a8-9503-59a2676095a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2', 'volume_size': 1} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1267468767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2d16f-0e7f-43a8-9503-59a2676095a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:15Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Creating volume d0f2d16f-0e7f-43a8-9503-59a2676095a2 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:15 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:15 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 1073741824 Aug 17 16:34:15 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [req-a4795c06-d32b-43d6-8d1f-42b4e44aec3c req-e130cc04-1a65-48b2-850b-2ac25b8b01da tempest-TestInstancesWithCinderVolumes-540805210 None] Terminate volume connection completed successfully. Aug 17 16:34:15 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [req-a4795c06-d32b-43d6-8d1f-42b4e44aec3c req-e130cc04-1a65-48b2-850b-2ac25b8b01da tempest-TestInstancesWithCinderVolumes-540805210 None] Deleting attachment 16c18e3c-4c21-4104-bc98-3535a1254d00. {{(pid=94468) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 17 16:34:16 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 1073741824" returned: 0 in 0.615s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:16 devstack sudo[113416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 Aug 17 16:34:16 devstack sudo[113416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:16 devstack sudo[113416]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2" returned: 0 in 0.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dd5f8e-0ed7-4844-875a-5c392b43f8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500b635-1f8e-4c6d-8bbb-94a6c35cf933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:16 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Volume volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 (d0f2d16f-0e7f-43a8-9503-59a2676095a2): created successfully Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8500b635-1f8e-4c6d-8bbb-94a6c35cf933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (f988fbe0-6a03-4691-a121-dabd3cd39a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:16 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9005c615-2bbb-40cb-8653-f4e0c63c1b45 tempest-ProjectReaderTests-1877915269 None] Created volume successfully. Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-0be295e2-63cf-4bb7-abed-deda5a2caf7d-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-0be295e2-63cf-4bb7-abed-deda5a2caf7d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "cinder-quobyte-0be295e2-63cf-4bb7-abed-deda5a2caf7d" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-0be295e2-63cf-4bb7-abed-deda5a2caf7d" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2af5dd7-0285-44a3-bc9e-e49fc3eb785f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:17 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d Aug 17 16:34:17 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:17 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:17 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d Aug 17 16:34:17 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:17 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-0be295e2-63cf-4bb7-abed-deda5a2caf7d" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-quobyte-0be295e2-63cf-4bb7-abed-deda5a2caf7d" released by "delete_volume" :: held 0.738s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-d0f2d16f-0e7f-43a8-9503-59a2676095a2-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-d0f2d16f-0e7f-43a8-9503-59a2676095a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:17 devstack cinder-volume[94468]: WARNING cinder.quota [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1454736972-1469373625 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1454736972-1469373625, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:17 devstack cinder-volume[94468]: WARNING cinder.quota [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1454736972-1469373625 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1454736972-1469373625, it is now deprecated. Please use the default quota class for default quota. Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-quobyte-d0f2d16f-0e7f-43a8-9503-59a2676095a2" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Created reservations ['63c78ba9-f7f2-4a40-9554-a98694a054c4', '76056059-b8ba-4a03-89d7-0afd0e84484b', '644dc733-6636-4fff-b731-a94847198de6', '0f8ef2c0-f012-4a15-8e0b-3330a223cde5'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-d0f2d16f-0e7f-43a8-9503-59a2676095a2" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a864406-34b5-4049-a0b0-8653c553f7f5]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:18 devstack sudo[113428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:18 devstack sudo[113428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:18 devstack sudo[113427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 Aug 17 16:34:18 devstack sudo[113427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:18 devstack sudo[113428]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.341s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:18 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Deleted volume successfully. Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29cc6063-4b42-406d-a882-cd86f7d47926 tempest-TestInstancesWithCinderVolumes-540805210 None] Lock "cinder-0be295e2-63cf-4bb7-abed-deda5a2caf7d-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:18 devstack sudo[113427]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2" returned: 0 in 0.493s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:18 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2 Aug 17 16:34:18 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:18 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d0f2d16f-0e7f-43a8-9503-59a2676095a2" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-d0f2d16f-0e7f-43a8-9503-59a2676095a2" released by "delete_volume" :: held 0.849s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Created reservations ['34692bcb-eb74-40bc-82a6-d0102c1bff2b', 'ed366823-de98-439d-b559-f6170b759126', '0a15d125-0943-472d-b303-5ff3cee17f5f', '98516b21-e74e-4a54-9304-6921c34652ea'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:18 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:18 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:19 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.317s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:19 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Deleted volume successfully. Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce31988e-6419-4eba-8598-c5d86bfc6cd4 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-d0f2d16f-0e7f-43a8-9503-59a2676095a2-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (a82a8335-4cf8-4b7b-a122-43374fc837ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511a263a-fe38-4750-9721-dede3e043bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511a263a-fe38-4750-9721-dede3e043bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145351315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1e458f-630f-4895-8ca6-2d642d380b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:20Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d88d83-831b-46e5-b99c-0d8456ae8355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d88d83-831b-46e5-b99c-0d8456ae8355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dcd265-70a2-4738-9d27-1569b39a2dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dcd265-70a2-4738-9d27-1569b39a2dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1e458f-630f-4895-8ca6-2d642d380b2e', 'volume_name': 'volume-5e1e458f-630f-4895-8ca6-2d642d380b2e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144b39de-20bf-4f3f-a7ab-f364fa1954b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (144b39de-20bf-4f3f-a7ab-f364fa1954b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b199d6-220c-4398-8e86-e69bd639c57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Volume 5e1e458f-630f-4895-8ca6-2d642d380b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1e458f-630f-4895-8ca6-2d642d380b2e', 'volume_size': 1} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145351315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1e458f-630f-4895-8ca6-2d642d380b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:20Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Creating volume 5e1e458f-630f-4895-8ca6-2d642d380b2e {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:19 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:19 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e 1073741824 Aug 17 16:34:19 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:20 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e 1073741824" returned: 0 in 0.578s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:20 devstack sudo[113448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e Aug 17 16:34:20 devstack sudo[113448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:20 devstack sudo[113448]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e" returned: 0 in 0.308s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b199d6-220c-4398-8e86-e69bd639c57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1e458f-630f-4895-8ca6-2d642d380b2e', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497803b-2ced-4853-8447-ef20b8daf964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Volume volume-5e1e458f-630f-4895-8ca6-2d642d380b2e (5e1e458f-630f-4895-8ca6-2d642d380b2e): created successfully Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3497803b-2ced-4853-8447-ef20b8daf964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (a82a8335-4cf8-4b7b-a122-43374fc837ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-789f1f1d-7df8-418b-9e87-d3441b4b8495 tempest-ProjectReaderTests-1877915269 None] Created volume successfully. Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-5e1e458f-630f-4895-8ca6-2d642d380b2e-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "cinder-5e1e458f-630f-4895-8ca6-2d642d380b2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-quobyte-5e1e458f-630f-4895-8ca6-2d642d380b2e" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-5e1e458f-630f-4895-8ca6-2d642d380b2e" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b5c564-b7ac-4dda-8b84-b22779ea2071]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:21 devstack sudo[113452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e Aug 17 16:34:21 devstack sudo[113452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:22 devstack sudo[113452]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e" returned: 0 in 0.447s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:22 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e Aug 17 16:34:22 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:22 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e1e458f-630f-4895-8ca6-2d642d380b2e" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-5e1e458f-630f-4895-8ca6-2d642d380b2e" released by "delete_volume" :: held 0.781s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Created reservations ['5d450216-2dc6-45dc-aec9-826f98a52c0e', 'af2a69b4-2d35-4ee3-9200-3c2112292c96', '2598456c-a8d5-4cd4-97ac-197c694038cb', 'cf132c5f-391a-4959-a3cc-764eeeafbbf7'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:22 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:22 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:23 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.461s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Deleted volume successfully. Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-017dc32d-e655-4f10-8ce9-007b5c8b503e tempest-ProjectReaderTests-1877915269 None] Lock "cinder-5e1e458f-630f-4895-8ca6-2d642d380b2e-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (ee6b3cf2-c1a0-43c6-97b4-f5689bb5a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a674c3-ed3e-4e97-958a-4f0daab1db79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a674c3-ed3e-4e97-958a-4f0daab1db79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280150227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c069f8-463e-4edd-97a4-3098d90625ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:24Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e396ce-d63d-4528-8902-cd39b030a4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e396ce-d63d-4528-8902-cd39b030a4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a172bce-40b4-4056-8569-6476118bf336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a172bce-40b4-4056-8569-6476118bf336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6c069f8-463e-4edd-97a4-3098d90625ab', 'volume_name': 'volume-d6c069f8-463e-4edd-97a4-3098d90625ab', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d386d6e-14c2-4d07-88ca-4c2f90a48173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d386d6e-14c2-4d07-88ca-4c2f90a48173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4397db8-8731-4da7-bc0e-d6fb90139f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Volume d6c069f8-463e-4edd-97a4-3098d90625ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6c069f8-463e-4edd-97a4-3098d90625ab', 'volume_size': 1} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-280150227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c069f8-463e-4edd-97a4-3098d90625ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:24Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Creating volume d6c069f8-463e-4edd-97a4-3098d90625ab {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:23 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:23 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab 1073741824 Aug 17 16:34:23 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:24 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab 1073741824" returned: 0 in 0.593s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:24 devstack sudo[113471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab Aug 17 16:34:24 devstack sudo[113471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:24 devstack sudo[113471]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab" returned: 0 in 0.313s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4397db8-8731-4da7-bc0e-d6fb90139f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c069f8-463e-4edd-97a4-3098d90625ab', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57a5405-9fea-446e-92a4-6cbb6c2fbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Volume volume-d6c069f8-463e-4edd-97a4-3098d90625ab (d6c069f8-463e-4edd-97a4-3098d90625ab): created successfully Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57a5405-9fea-446e-92a4-6cbb6c2fbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (ee6b3cf2-c1a0-43c6-97b4-f5689bb5a473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2e643a6e-2134-445d-984b-567a333ce6c0 tempest-ProjectReaderTests-1877915269 None] Created volume successfully. Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-d6c069f8-463e-4edd-97a4-3098d90625ab-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "cinder-d6c069f8-463e-4edd-97a4-3098d90625ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-quobyte-d6c069f8-463e-4edd-97a4-3098d90625ab" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-d6c069f8-463e-4edd-97a4-3098d90625ab" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8963f-bfe6-4271-a833-e5d587e1f0af]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:26 devstack sudo[113475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab Aug 17 16:34:26 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:26 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab" returned: 0 in 0.561s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:26 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab Aug 17 16:34:26 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:27 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d6c069f8-463e-4edd-97a4-3098d90625ab" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-d6c069f8-463e-4edd-97a4-3098d90625ab" released by "delete_volume" :: held 0.987s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Created reservations ['42e2a39a-dc57-4c07-a0ef-9b1212657929', '894b64eb-0c6e-43ca-ab20-44d88e71c8a8', '12206acd-d1be-4c8a-a63a-82e09a346581', '2d1df3ce-cf5b-4e5a-8979-3237317b5ce9'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:27 devstack sudo[113485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:27 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:27 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Deleted volume successfully. Aug 17 16:34:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2195625-3679-4fb3-9ad7-03752a89746d tempest-ProjectReaderTests-1877915269 None] Lock "cinder-d6c069f8-463e-4edd-97a4-3098d90625ab-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Flow 'volume_create_manager' (a89c4c15-c72f-490f-bee5-68f19cce6ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f8dd9-bfdf-4322-af83-59df934bacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366f8dd9-bfdf-4322-af83-59df934bacf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-812599835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8bd503-6a6a-4e84-985e-3a85da21ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ec11ab1644366b85a5264bdb98f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:28Z,use_quota=True,user_id='f4734ee67ebb41b989f154f844529dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f9ab4d-6564-4ff0-8127-d6ca3393b64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73f9ab4d-6564-4ff0-8127-d6ca3393b64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735907c9-38a0-4d71-89d2-27ccc2d8bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735907c9-38a0-4d71-89d2-27ccc2d8bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8bd503-6a6a-4e84-985e-3a85da21ac17', 'volume_name': 'volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459cf0af-9399-471c-9eda-1504fe95e165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459cf0af-9399-471c-9eda-1504fe95e165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d05b54-4460-441d-a4c7-bd7f0165b513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Volume 4e8bd503-6a6a-4e84-985e-3a85da21ac17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17', 'volume_size': 1} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-812599835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8bd503-6a6a-4e84-985e-3a85da21ac17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ec11ab1644366b85a5264bdb98f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:28Z,use_quota=True,user_id='f4734ee67ebb41b989f154f844529dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Creating volume 4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:28 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:28 devstack sudo[113488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 1073741824 Aug 17 16:34:28 devstack sudo[113488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:28 devstack sudo[113488]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 1073741824" returned: 0 in 0.590s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:28 devstack sudo[113495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:28 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:29 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d05b54-4460-441d-a4c7-bd7f0165b513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1132d75-3f13-4efd-b902-8994816607c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (7c629c94-77fc-4248-8da4-b425814f36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1c2103-85bb-4ba9-a2ff-cfb2757b7db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Volume volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 (4e8bd503-6a6a-4e84-985e-3a85da21ac17): created successfully Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1132d75-3f13-4efd-b902-8994816607c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Flow 'volume_create_manager' (a89c4c15-c72f-490f-bee5-68f19cce6ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1c2103-85bb-4ba9-a2ff-cfb2757b7db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737265991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f200033-6aa2-40c6-a176-33a27c70d867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:29Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dab690-2621-4303-a727-e88ce796b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dab690-2621-4303-a727-e88ce796b260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51ea40e-204f-4f21-aee2-9aab84a1f695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51ea40e-204f-4f21-aee2-9aab84a1f695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f200033-6aa2-40c6-a176-33a27c70d867', 'volume_name': 'volume-4f200033-6aa2-40c6-a176-33a27c70d867', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f188193-3238-40e9-a53e-37646704e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f188193-3238-40e9-a53e-37646704e053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e52c0-b717-4d5a-a0c6-86f583a37c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Volume 4f200033-6aa2-40c6-a176-33a27c70d867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f200033-6aa2-40c6-a176-33a27c70d867', 'volume_size': 1} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737265991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f200033-6aa2-40c6-a176-33a27c70d867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2b85fd8c8d14e658b88da2e1e48fb25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:29Z,use_quota=True,user_id='7e05512fc2074613a50c08a7b95082e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Creating volume 4f200033-6aa2-40c6-a176-33a27c70d867 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:29 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-063258e5-2081-47c0-9b0e-d46513e58c47 tempest-SnapshotDependencyTests-1555133303 None] Created volume successfully. Aug 17 16:34:29 devstack sudo[113498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 1073741824 Aug 17 16:34:29 devstack sudo[113498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:29 devstack sudo[113498]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 1073741824" returned: 0 in 0.513s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:29 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 Aug 17 16:34:29 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:30 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867" returned: 0 in 0.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e52c0-b717-4d5a-a0c6-86f583a37c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f200033-6aa2-40c6-a176-33a27c70d867', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ad2dd-f390-4402-b30b-8488c94e5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:30 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Volume volume-4f200033-6aa2-40c6-a176-33a27c70d867 (4f200033-6aa2-40c6-a176-33a27c70d867): created successfully Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174ad2dd-f390-4402-b30b-8488c94e5196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Flow 'volume_create_manager' (7c629c94-77fc-4248-8da4-b425814f36ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0cedcf80-b512-418a-ac8e-1935d0401aba tempest-ProjectReaderTests-1877915269 None] Created volume successfully. Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Creating offline snapshot c662d1ac-da73-4b10-b15f-d63f563f6552 of volume 4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf4b64-c178-4503-a240-44af44fb13ff]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:30 devstack sudo[113511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:30 devstack sudo[113511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:30 devstack sudo[113511]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:30 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 1G Aug 17 16:34:30 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-4f200033-6aa2-40c6-a176-33a27c70d867-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-4f200033-6aa2-40c6-a176-33a27c70d867-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "cinder-quobyte-4f200033-6aa2-40c6-a176-33a27c70d867" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-4f200033-6aa2-40c6-a176-33a27c70d867" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9349fa77-57d7-4944-ac63-92766e79cdc0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:31 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 Aug 17 16:34:31 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:31 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 1G" returned: 0 in 0.595s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:31 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:31 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:31 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867" returned: 0 in 0.408s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:31 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867 Aug 17 16:34:31 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:31 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.330s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:31 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 is being set with open permissions: ugo+rw Aug 17 16:34:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:31 devstack sudo[113536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:31 devstack sudo[113536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:32 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4f200033-6aa2-40c6-a176-33a27c70d867" returned: 0 in 0.280s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-quobyte-4f200033-6aa2-40c6-a176-33a27c70d867" released by "delete_volume" :: held 0.737s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Created reservations ['5a553702-6fc7-4f2f-b3b2-4c77e92f1ced', '5d443f7f-df0b-48f9-b0e8-06f2d8453abe', '648eb853-87a4-4e65-a4f1-b53939b3c4bf', '6474a7c9-1b79-4571-8947-80c98baa6b79'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:32 devstack sudo[113536]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:32 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info Aug 17 16:34:32 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:32 devstack sudo[113541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:32 devstack sudo[113541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:32 devstack sudo[113541]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.293s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Deleted volume successfully. Aug 17 16:34:32 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info" returned: 0 in 0.335s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:32 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info is being set with open permissions: ugo+rw Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:32 devstack sudo[113546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info Aug 17 16:34:32 devstack sudo[113546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-833c70ef-f55e-4720-be65-1b47615576e3 tempest-ProjectReaderTests-1877915269 None] Lock "cinder-4f200033-6aa2-40c6-a176-33a27c70d867-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:32 devstack sudo[113546]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.info" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2e950f66-d8f6-49ea-931c-c6e341a99e04 tempest-SnapshotDependencyTests-1555133303 None] Create snapshot completed successfully Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Flow 'volume_create_manager' (a7724fa8-6551-4d71-83a5-a34592e61159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82dc670-f109-4d6a-9e85-6fdfeecc3a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82dc670-f109-4d6a-9e85-6fdfeecc3a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1696502067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477c11f2-5f7a-46d1-a719-3e0ca97fb352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3543e7edae42138f49d4ab95ffa32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:33Z,use_quota=True,user_id='3821e372dce9457ca2dd776c738b0de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a8482f-a085-44ef-9b0f-b95714d2b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a8482f-a085-44ef-9b0f-b95714d2b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d04c87-9dc6-4218-a166-d2d26c6e1578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d04c87-9dc6-4218-a166-d2d26c6e1578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477c11f2-5f7a-46d1-a719-3e0ca97fb352', 'volume_name': 'volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88302ed8-61c2-455e-a449-9ad987823a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88302ed8-61c2-455e-a449-9ad987823a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2cbf65-fca5-4e86-856c-4d22564f9cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Volume 477c11f2-5f7a-46d1-a719-3e0ca97fb352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352', 'volume_size': 1} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1696502067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477c11f2-5f7a-46d1-a719-3e0ca97fb352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3543e7edae42138f49d4ab95ffa32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:33Z,use_quota=True,user_id='3821e372dce9457ca2dd776c738b0de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Creating volume 477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:33 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 1073741824 Aug 17 16:34:33 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:33 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 1073741824" returned: 0 in 0.603s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:34 devstack sudo[113592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:34 devstack sudo[113592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:34 devstack sudo[113592]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.343s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce2cbf65-fca5-4e86-856c-4d22564f9cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4328389-ee83-41ef-9c9c-e54a8475c797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Volume volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 (477c11f2-5f7a-46d1-a719-3e0ca97fb352): created successfully Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4328389-ee83-41ef-9c9c-e54a8475c797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Flow 'volume_create_manager' (a7724fa8-6551-4d71-83a5-a34592e61159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-79e4d508-031d-4f9a-ade7-83ce38bc0a3b tempest-VolumeDependencyTests-1400197826 None] Created volume successfully. Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Flow 'volume_create_manager' (8e652641-d8a7-4aab-b921-e0ec6b1b84ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0633aabf-222d-49c7-985b-0da084e1d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0633aabf-222d-49c7-985b-0da084e1d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a8a608-da32-4eb7-8c07-9341d75e452a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ec11ab1644366b85a5264bdb98f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c662d1ac-da73-4b10-b15f-d63f563f6552,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:34Z,use_quota=True,user_id='f4734ee67ebb41b989f154f844529dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64719334-3389-42bc-968d-21c225c2a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64719334-3389-42bc-968d-21c225c2a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e782613a-f41b-4549-97dd-33f73739c251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e782613a-f41b-4549-97dd-33f73739c251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39a8a608-da32-4eb7-8c07-9341d75e452a', 'volume_name': 'volume-39a8a608-da32-4eb7-8c07-9341d75e452a', 'volume_size': 1, 'snapshot_id': 'c662d1ac-da73-4b10-b15f-d63f563f6552'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d480ec63-d721-45f9-a98e-e7a79fc86c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d480ec63-d721-45f9-a98e-e7a79fc86c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e141d9f-51f9-4374-a4a8-bb1ee2ceb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Volume 39a8a608-da32-4eb7-8c07-9341d75e452a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39a8a608-da32-4eb7-8c07-9341d75e452a', 'volume_size': 1, 'snapshot_id': 'c662d1ac-da73-4b10-b15f-d63f563f6552'} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552-39a8a608-da32-4eb7-8c07-9341d75e452a" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552-39a8a608-da32-4eb7-8c07-9341d75e452a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Creating volume 39a8a608-da32-4eb7-8c07-9341d75e452a from snapshot c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] snapshot: c662d1ac-da73-4b10-b15f-d63f563f6552, volume: 39a8a608-da32-4eb7-8c07-9341d75e452a, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17851875-cce5-4b1f-b1ed-91b5897846be]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:34 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:34 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:34 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac726ab-0b25-4107-8f02-e0d08a4c17c0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:35 devstack sudo[113600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:35 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:35 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:35 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a Aug 17 16:34:35 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:39 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a" returned: 0 in 3.834s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:34:39 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Converted 1024.00 MB image at 267.01 MB/s Aug 17 16:34:39 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a is being set with open permissions: ugo+rw Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:39 devstack sudo[113618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a Aug 17 16:34:39 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:39 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a" returned: 0 in 0.236s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" released by "_copy_volume_from_snapshot" :: held 4.861s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=152,cinder:INSERT=51,cinder:UPDATE=202,cinder:DELETE=20 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:INSERT=48,cinder:UPDATE=216,cinder:SELECT=160,cinder:DELETE=14 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552-39a8a608-da32-4eb7-8c07-9341d75e452a" released by "_create_volume_from_snapshot" :: held 4.929s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.945s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.970s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Creating offline snapshot 796248e2-0a0d-4f2a-be6f-909983213598 of volume 477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e141d9f-51f9-4374-a4a8-bb1ee2ceb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a8a608-da32-4eb7-8c07-9341d75e452a', 'volume_size': 1, 'snapshot_id': 'c662d1ac-da73-4b10-b15f-d63f563f6552'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de801f-a581-4a42-84e1-aa483b5b7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41bb169-7e3a-4be0-b1d6-352c4d522cd6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Volume volume-39a8a608-da32-4eb7-8c07-9341d75e452a (39a8a608-da32-4eb7-8c07-9341d75e452a): created successfully Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75de801f-a581-4a42-84e1-aa483b5b7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Flow 'volume_create_manager' (8e652641-d8a7-4aab-b921-e0ec6b1b84ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f5c05425-a93b-47c4-8701-0b7eed691a91 tempest-SnapshotDependencyTests-1555133303 None] Created volume successfully. Aug 17 16:34:39 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:39 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:39 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.360s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:39 devstack sudo[113626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 1G Aug 17 16:34:39 devstack sudo[113626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-c662d1ac-da73-4b10-b15f-d63f563f6552-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-c662d1ac-da73-4b10-b15f-d63f563f6552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Deleting offline snapshot c662d1ac-da73-4b10-b15f-d63f563f6552 of volume 4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] snapshot_file for this snap is: volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6307795-25be-4c51-84c7-f72335469d25]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:40 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:40 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:40 devstack sudo[113626]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 1G" returned: 0 in 0.419s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:40 devstack sudo[113633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:40 devstack sudo[113633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:40 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ceace-ca8a-4b65-ba34-01d4cb1bcd24]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:40 devstack sudo[113633]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:40 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 is being set with open permissions: ugo+rw Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:40 devstack sudo[113642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:40 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:40 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:40 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:40 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.264s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:40 devstack sudo[113648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info Aug 17 16:34:40 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:41 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.565s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:41 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:41 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:41 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:41 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info is being set with open permissions: ugo+rw Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:41 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info Aug 17 16:34:41 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:41 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.info" returned: 0 in 0.242s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:41 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1a936f8d-8a6f-49e8-a5a5-f2526b7ba112 tempest-VolumeDependencyTests-1400197826 None] Create snapshot completed successfully Aug 17 16:34:41 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552 Aug 17 16:34:41 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:41 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17.c662d1ac-da73-4b10-b15f-d63f563f6552" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-c662d1ac-da73-4b10-b15f-d63f563f6552" released by "_delete_snapshot" :: held 1.660s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" released by "delete_snapshot" :: held 1.685s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Created reservations ['607942b5-78ec-478d-8119-7a109eb82761', '2d1634c7-9654-4a14-a38a-240490696d32', '656ac1e4-eb91-4c4a-87b7-710b3567d173', '54273b22-f06f-4d48-8f65-e0096d069c52'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Delete snapshot completed successfully. Aug 17 16:34:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9fb59121-af44-4f35-ab40-337f09fa5009 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-c662d1ac-da73-4b10-b15f-d63f563f6552-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-4e8bd503-6a6a-4e84-985e-3a85da21ac17-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-4e8bd503-6a6a-4e84-985e-3a85da21ac17-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965162a-b696-4d55-a9ca-db7ad07a23d2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Flow 'volume_create_manager' (2e207d44-48d9-43ee-b836-90a1ff89105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437914f-0d3b-47e5-aedf-064b7f71544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437914f-0d3b-47e5-aedf-064b7f71544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-387974118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54fd203-347f-4d3c-b1f4-ac8810a0daa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb3543e7edae42138f49d4ab95ffa32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=796248e2-0a0d-4f2a-be6f-909983213598,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:34:42Z,use_quota=True,user_id='3821e372dce9457ca2dd776c738b0de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f58334-4c75-4b75-a55c-ff2d6a876583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f58334-4c75-4b75-a55c-ff2d6a876583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7baf4-0892-44b6-937c-082bf0cda800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33f7baf4-0892-44b6-937c-082bf0cda800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e54fd203-347f-4d3c-b1f4-ac8810a0daa6', 'volume_name': 'volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6', 'volume_size': 1, 'snapshot_id': '796248e2-0a0d-4f2a-be6f-909983213598'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c89e93-24aa-4996-a3f1-5aa097b9b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:42 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:42 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c89e93-24aa-4996-a3f1-5aa097b9b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402182df-c16d-4c09-9973-e1e78b076b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Volume e54fd203-347f-4d3c-b1f4-ac8810a0daa6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6', 'volume_size': 1, 'snapshot_id': '796248e2-0a0d-4f2a-be6f-909983213598'} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Creating volume e54fd203-347f-4d3c-b1f4-ac8810a0daa6 from snapshot 796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] snapshot: 796248e2-0a0d-4f2a-be6f-909983213598, volume: e54fd203-347f-4d3c-b1f4-ac8810a0daa6, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b38b52-d40b-4d7d-b72c-6a546f5e1504]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:42 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:42 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:42 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.380s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:42 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17 Aug 17 16:34:42 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:43 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.407s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:34:43 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e8bd503-6a6a-4e84-985e-3a85da21ac17" returned: 0 in 0.253s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e973e2-1520-414f-9001-902710ce0ae6]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-4e8bd503-6a6a-4e84-985e-3a85da21ac17" released by "delete_volume" :: held 0.700s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Created reservations ['6feb01ad-23d8-4c5e-b4e2-fd86d1dd34ac', '440f77f3-4c2c-4a71-bfdc-f1f2a06fd5d5', 'dcab4ba4-2357-4631-b3ee-c6bc94bc6b80', '42e7410b-0b56-4a55-aaa6-cf0e0848749b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:43 devstack sudo[113676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:43 devstack sudo[113676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:43 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:43 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:43 devstack sudo[113676]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.357s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:43 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.265s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:43 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 Aug 17 16:34:43 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Deleted volume successfully. Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-39a8a608-da32-4eb7-8c07-9341d75e452a-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-705625e9-62d6-4dd0-bf4b-a0d0d0aa0810 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-4e8bd503-6a6a-4e84-985e-3a85da21ac17-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-39a8a608-da32-4eb7-8c07-9341d75e452a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeb953d-b641-43c1-a3fd-6bcd13070307]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:43 devstack sudo[113686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a Aug 17 16:34:43 devstack sudo[113686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:44 devstack sudo[113686]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:44 devstack sudo[113702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a Aug 17 16:34:44 devstack sudo[113702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:44 devstack sudo[113702]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39a8a608-da32-4eb7-8c07-9341d75e452a" returned: 0 in 0.761s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-quobyte-39a8a608-da32-4eb7-8c07-9341d75e452a" released by "delete_volume" :: held 1.319s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Created reservations ['40286bb0-aa1f-4be5-a9ef-405f33265015', 'ea86c279-cbc5-49a5-aef4-06d2301e6019', '20d965bd-e3c3-4c29-a3b8-468ec7f0eea9', 'e505c81e-44e3-4675-b745-3fd4cf51ac2d'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:45 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:45 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:45 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Deleted volume successfully. Aug 17 16:34:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9a713a71-d936-4cf1-adf5-2fdb5bd6c185 tempest-SnapshotDependencyTests-1555133303 None] Lock "cinder-39a8a608-da32-4eb7-8c07-9341d75e452a-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:46 devstack sudo[113709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:46 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:47 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.630s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:34:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:34:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:34:48 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" returned: 0 in 5.058s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:34:48 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Converted 1024.00 MB image at 202.37 MB/s Aug 17 16:34:48 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 is being set with open permissions: ugo+rw Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:48 devstack sudo[113712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 Aug 17 16:34:48 devstack sudo[113712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:48 devstack sudo[113712]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" returned: 0 in 0.262s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" released by "_copy_volume_from_snapshot" :: held 6.169s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" released by "_create_volume_from_snapshot" :: held 6.241s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.258s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402182df-c16d-4c09-9973-e1e78b076b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6', 'volume_size': 1, 'snapshot_id': '796248e2-0a0d-4f2a-be6f-909983213598'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23d66d1-01ea-4669-89b4-d7aeb601f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Volume volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 (e54fd203-347f-4d3c-b1f4-ac8810a0daa6): created successfully Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23d66d1-01ea-4669-89b4-d7aeb601f378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Flow 'volume_create_manager' (2e207d44-48d9-43ee-b836-90a1ff89105a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d76c1288-8912-40ba-8d88-c44bbad427b5 tempest-VolumeDependencyTests-1400197826 None] Created volume successfully. Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-796248e2-0a0d-4f2a-be6f-909983213598-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-796248e2-0a0d-4f2a-be6f-909983213598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Deleting offline snapshot 796248e2-0a0d-4f2a-be6f-909983213598 of volume 477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] snapshot_file for this snap is: volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c1fc9d-1a72-4856-aa7c-6bb086c6624e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:49 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:49 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:49 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acde177-a76e-4d28-bbb9-384834fac1d3]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:49 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:49 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:50 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.607s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:50 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:50 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:50 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.342s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:50 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598 Aug 17 16:34:50 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:50 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352.796248e2-0a0d-4f2a-be6f-909983213598" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-796248e2-0a0d-4f2a-be6f-909983213598" released by "_delete_snapshot" :: held 1.712s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" released by "delete_snapshot" :: held 1.739s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Created reservations ['cbf31e08-f2f5-4da5-aa1c-bbb5d85c65af', '5bebc750-b6f4-4d34-afe9-fd66976ee1ab', 'a42d9f41-3abd-4925-a73d-886fb3e603a4', 'ff7b6ba3-fc1d-4569-8be1-a478694690b9'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Delete snapshot completed successfully. Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-89011375-85ec-4c7b-a26a-d4a3abfe34cf tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-796248e2-0a0d-4f2a-be6f-909983213598-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-477c11f2-5f7a-46d1-a719-3e0ca97fb352-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-477c11f2-5f7a-46d1-a719-3e0ca97fb352-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7c70ac-36a9-4542-acbf-135fab054098]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:51 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:51 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:51 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.389s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:52 devstack sudo[113739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352 Aug 17 16:34:52 devstack sudo[113739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:52 devstack sudo[113739]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-477c11f2-5f7a-46d1-a719-3e0ca97fb352" returned: 0 in 0.293s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-477c11f2-5f7a-46d1-a719-3e0ca97fb352" released by "delete_volume" :: held 0.776s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Created reservations ['e3f3486e-540b-41c3-8568-ea5137881aa9', 'c34cb46a-a22c-4253-a094-0a4c21ac66a1', 'af8612f8-d026-42dd-a074-ee1edfa2015b', 'e3b56fa0-9ab4-4902-8873-6dbfc91a014e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:52 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:52 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-e54fd203-347f-4d3c-b1f4-ac8810a0daa6-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-e54fd203-347f-4d3c-b1f4-ac8810a0daa6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:34:52 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.320s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:52 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Deleted volume successfully. Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d5851073-ca9f-4198-83d0-bb033d4a20b0 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-477c11f2-5f7a-46d1-a719-3e0ca97fb352-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b0c136-5680-4dcb-b126-76e9a37ac9b2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:34:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:52 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 Aug 17 16:34:52 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:53 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" returned: 0 in 0.391s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:53 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6 Aug 17 16:34:53 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:53 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" returned: 0 in 0.247s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-quobyte-e54fd203-347f-4d3c-b1f4-ac8810a0daa6" released by "delete_volume" :: held 0.689s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Created reservations ['cb5b0d03-c6e6-4f1a-87d1-41b5708b8f70', '34ff2310-2475-42c6-a597-e6d648434db4', 'f1a21f6c-46cb-49f1-8e58-45e47917d653', 'c6a6cd95-4346-424c-9bd8-6dbf3da44ebb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:34:53 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:34:53 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:34:53 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:34:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Deleted volume successfully. Aug 17 16:34:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-74023d33-4143-42ed-b781-8b62b7e97634 tempest-VolumeDependencyTests-1400197826 None] Lock "cinder-e54fd203-347f-4d3c-b1f4-ac8810a0daa6-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Flow 'volume_create_manager' (c541ec9c-0496-4f04-a69b-fbbee5926c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e9462-2c87-4437-81af-1c39682ebb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (280e9462-2c87-4437-81af-1c39682ebb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115b93b9-f81c-486e-9542-70dc2ca3fdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cf3d93d7ce40fda2746876a50cc2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:00Z,use_quota=True,user_id='d03399bd62aa4b9382873d92e3b7d670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad5bf4d-7255-48ac-ba6f-f6914beba8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad5bf4d-7255-48ac-ba6f-f6914beba8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dfe461-2635-40fe-9b89-fa61f7332ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:34:59 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dfe461-2635-40fe-9b89-fa61f7332ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '115b93b9-f81c-486e-9542-70dc2ca3fdb6', 'volume_name': 'volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6', 'volume_size': 1, 'image_id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a6b2347d4f933956e977da6a25e15cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5cf3d93d7ce40fda2746876a50cc2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e81ff58f36a85e4267fc94384af51738c17a37e5b4cada97992c04bb4460db177c2d45684df0ed067ef979064a8f76fe9af8d24aceaf300b074a1b495f4d972', 'id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'created_at': datetime.datetime(2026, 8, 17, 14, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94273a4e-2c6c-420a-b804-ea31dc0351a6/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beffcffb-e7a8-4e9a-9343-f15015f9bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beffcffb-e7a8-4e9a-9343-f15015f9bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cb75ec-7d4a-4696-af23-353410f8a763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6', 'volume_size': 1, 'image_id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a6b2347d4f933956e977da6a25e15cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5cf3d93d7ce40fda2746876a50cc2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e81ff58f36a85e4267fc94384af51738c17a37e5b4cada97992c04bb4460db177c2d45684df0ed067ef979064a8f76fe9af8d24aceaf300b074a1b495f4d972', 'id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'created_at': datetime.datetime(2026, 8, 17, 14, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94273a4e-2c6c-420a-b804-ea31dc0351a6/file', 'properties': {}}, 'image_service': } Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Trying to clone 115b93b9-f81c-486e-9542-70dc2ca3fdb6 from image 94273a4e-2c6c-420a-b804-ea31dc0351a6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:35:00 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Image download 0.00 MB at 0.00 MB/s Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ee6b7-e666-4451-90b5-968d2ffdb90f]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:00 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:00 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:00 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:00 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:00 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:01 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Temporary image 94273a4e-2c6c-420a-b804-ea31dc0351a6 is fetched for user d03399bd62aa4b9382873d92e3b7d670. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e3186b-6516-455a-9566-34a96b467f41]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:01 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:01 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:01 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:01 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:01 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:01 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115b93b9-f81c-486e-9542-70dc2ca3fdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cf3d93d7ce40fda2746876a50cc2dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:00Z,use_quota=True,user_id='d03399bd62aa4b9382873d92e3b7d670',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Creating volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:01 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:01 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1073741824 Aug 17 16:35:01 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:02 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1073741824" returned: 0 in 0.420s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:02 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 Aug 17 16:35:02 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:02 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6" returned: 0 in 0.252s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Attempting download of 94273a4e-2c6c-420a-b804-ea31dc0351a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}])) to volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e246d598-3ef1-43c6-a37a-d9c9bf7d4520]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:02 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n Aug 17 16:35:02 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:02 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:02 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n Aug 17 16:35:02 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:03 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n" returned: 1 in 0.323s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94273a4e-2c6c-420a-b804-ea31dc0351a6_5co3762n' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf0483f-a41d-41a4-966d-d6ad7423bb1e]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:03 devstack sudo[113802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:03 devstack sudo[113802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:03 devstack sudo[113802]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:03 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD Aug 17 16:35:03 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:03 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] 94273a4e-2c6c-420a-b804-ea31dc0351a6 was raw, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:35:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:03 devstack sudo[113812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 Aug 17 16:35:03 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:04 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94273a4e-2c6c-420a-b804-ea31dc0351a6_7t4rvawodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:35:04 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:04 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1G Aug 17 16:35:04 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:04 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 1G" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Downloaded image 94273a4e-2c6c-420a-b804-ea31dc0351a6 ((None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}])) to volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Temporary image 94273a4e-2c6c-420a-b804-ea31dc0351a6 for user d03399bd62aa4b9382873d92e3b7d670 is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Marking volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Copying metadata from image 94273a4e-2c6c-420a-b804-ea31dc0351a6 to 115b93b9-f81c-486e-9542-70dc2ca3fdb6. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Creating volume glance metadata for volume 115b93b9-f81c-486e-9542-70dc2ca3fdb6 backed by image 94273a4e-2c6c-420a-b804-ea31dc0351a6 with: {'image_id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8a6b2347d4f933956e977da6a25e15cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cb75ec-7d4a-4696-af23-353410f8a763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6', 'volume_size': 1, 'image_id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94273a4e-2c6c-420a-b804-ea31dc0351a6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a6b2347d4f933956e977da6a25e15cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5cf3d93d7ce40fda2746876a50cc2dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e81ff58f36a85e4267fc94384af51738c17a37e5b4cada97992c04bb4460db177c2d45684df0ed067ef979064a8f76fe9af8d24aceaf300b074a1b495f4d972', 'id': '94273a4e-2c6c-420a-b804-ea31dc0351a6', 'created_at': datetime.datetime(2026, 8, 17, 14, 34, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94273a4e-2c6c-420a-b804-ea31dc0351a6/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c8a82c-2c1e-404d-b8cc-54d1ff229b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:04 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Volume volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 (115b93b9-f81c-486e-9542-70dc2ca3fdb6): created successfully Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c8a82c-2c1e-404d-b8cc-54d1ff229b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:04 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Flow 'volume_create_manager' (c541ec9c-0496-4f04-a69b-fbbee5926c29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1b7504d0-3e77-4fd5-b1cf-def4a13db30a tempest-VolumeImageDependencyTests-1372498832 None] Created volume successfully. Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Acquiring lock "cinder-115b93b9-f81c-486e-9542-70dc2ca3fdb6-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "cinder-115b93b9-f81c-486e-9542-70dc2ca3fdb6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Acquiring lock "cinder-quobyte-115b93b9-f81c-486e-9542-70dc2ca3fdb6" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "cinder-quobyte-115b93b9-f81c-486e-9542-70dc2ca3fdb6" acquired by "delete_volume" :: waited 0.013s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7caecb4-fb1b-4297-a4e3-3c120e12f4c0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:05 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 Aug 17 16:35:05 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:05 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6" returned: 0 in 0.349s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:05 devstack sudo[113828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6 Aug 17 16:35:05 devstack sudo[113828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:05 devstack sudo[113828]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-115b93b9-f81c-486e-9542-70dc2ca3fdb6" returned: 0 in 0.236s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "cinder-quobyte-115b93b9-f81c-486e-9542-70dc2ca3fdb6" released by "delete_volume" :: held 0.626s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Created reservations ['b2a25d85-e9ad-433d-a103-a70d15af6079', '8b006b19-6ec8-4e5f-80be-4bb33c23e760', '2892f0e5-138f-48dc-9263-8dbfe7fea5ec', 'dfa4abf2-4205-486b-a9aa-4353aa96454b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:05 devstack sudo[113831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:05 devstack sudo[113831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:06 devstack sudo[113831]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.242s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Deleted volume successfully. Aug 17 16:35:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4039db37-70eb-4120-9275-11f57cacf8ca tempest-VolumeImageDependencyTests-1372498832 None] Lock "cinder-115b93b9-f81c-486e-9542-70dc2ca3fdb6-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:15 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=50,cinder:UPDATE=63,cinder:INSERT=19,cinder:DELETE=4 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:35:16 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=53,cinder:INSERT=22,cinder:UPDATE=61,cinder:DELETE=5 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (1b1a3b77-b9b9-40dd-bfb3-094915098f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799dc8b7-da74-4875-b9a7-7e43d7c6c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799dc8b7-da74-4875-b9a7-7e43d7c6c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108329418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e759be6-8847-4d25-9759-c2b298bb6aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:18Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903d0448-2c71-4c07-ad56-91160e1a5abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903d0448-2c71-4c07-ad56-91160e1a5abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b2b2d5-dbd6-4bab-818d-61d294ef1712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b2b2d5-dbd6-4bab-818d-61d294ef1712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e759be6-8847-4d25-9759-c2b298bb6aa2', 'volume_name': 'volume-4e759be6-8847-4d25-9759-c2b298bb6aa2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc77f231-1903-4039-a7f3-c9c8aa0e25e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc77f231-1903-4039-a7f3-c9c8aa0e25e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11b2fa2-27a8-4daa-b598-fcb3fd461786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Volume 4e759be6-8847-4d25-9759-c2b298bb6aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e759be6-8847-4d25-9759-c2b298bb6aa2', 'volume_size': 1} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108329418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e759be6-8847-4d25-9759-c2b298bb6aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:18Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Creating volume 4e759be6-8847-4d25-9759-c2b298bb6aa2 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:18 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:18 devstack sudo[113876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 1073741824 Aug 17 16:35:18 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (50255b6e-1fbe-46cf-aa32-ef9084a92d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3184280f-76fe-4bdb-921e-be7c68f928b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3184280f-76fe-4bdb-921e-be7c68f928b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769687089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:18Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991a89c0-96aa-4ee8-982f-29e5917bcd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (991a89c0-96aa-4ee8-982f-29e5917bcd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e07e27-9f7d-4d3a-8d16-ec98d8376612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e07e27-9f7d-4d3a-8d16-ec98d8376612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0', 'volume_name': 'volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e91660b-275a-4a90-b905-61af47ef6a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e91660b-275a-4a90-b905-61af47ef6a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7494dca3-a234-4e1b-9083-e42f44c37cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume 7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0', 'volume_size': 1} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (2dbeff33-595d-426e-981f-6b576af3f160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16be85a-6f90-47d8-b294-176bf1c0cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16be85a-6f90-47d8-b294-176bf1c0cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990865773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc828cbc-cb2e-434a-b193-732c03f8de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c95124-ce46-48ae-b047-68f664a8a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56c95124-ce46-48ae-b047-68f664a8a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:18 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3378c9-b575-47c2-82cd-f189a3b45c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3378c9-b575-47c2-82cd-f189a3b45c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc828cbc-cb2e-434a-b193-732c03f8de09', 'volume_name': 'volume-bc828cbc-cb2e-434a-b193-732c03f8de09', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272e24a2-c7ec-49cd-850d-f6ffb4b79969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272e24a2-c7ec-49cd-850d-f6ffb4b79969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74aa7b72-7122-4dc5-8d77-0e9de7cf82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Volume bc828cbc-cb2e-434a-b193-732c03f8de09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc828cbc-cb2e-434a-b193-732c03f8de09', 'volume_size': 1} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Flow 'volume_create_manager' (b518ccae-4bd4-4b36-a2cc-66a2f4c7d74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633e13bc-8a75-4002-b655-dfe3c3425d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633e13bc-8a75-4002-b655-dfe3c3425d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-845662319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86835952-e8c4-434f-adea-735eb0153710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06fc23e59896441aa0a8ac125e71a9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='e7593fc9ea62444296cc71b58b1a66a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ea201-5335-4b50-b3b1-4bae40a52af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80ea201-5335-4b50-b3b1-4bae40a52af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4468cd1-25f5-4ab5-a418-f413cec14cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4468cd1-25f5-4ab5-a418-f413cec14cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86835952-e8c4-434f-adea-735eb0153710', 'volume_name': 'volume-86835952-e8c4-434f-adea-735eb0153710', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e782ab-b580-4ec6-b000-43c33668b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68e782ab-b580-4ec6-b000-43c33668b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e1d150-1d7f-477e-9710-5c6d98244cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Volume 86835952-e8c4-434f-adea-735eb0153710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86835952-e8c4-434f-adea-735eb0153710', 'volume_size': 1} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (8023cfda-4dbc-46b1-800f-47c3b9a0939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed8a7b3-56f1-48cc-8f87-6f92045e68bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 1073741824" returned: 0 in 0.782s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed8a7b3-56f1-48cc-8f87-6f92045e68bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111866370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c20477-9d14-4199-a72a-c527bcf3e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03718f24-84ed-4292-bd97-b14623d51fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03718f24-84ed-4292-bd97-b14623d51fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c6d95b-458a-42e8-aa6e-a523e8c5bce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c6d95b-458a-42e8-aa6e-a523e8c5bce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c20477-9d14-4199-a72a-c527bcf3e92b', 'volume_name': 'volume-00c20477-9d14-4199-a72a-c527bcf3e92b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e14864-a780-4ddd-94fd-574f4d92076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e14864-a780-4ddd-94fd-574f4d92076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16755884-c05e-4900-a44e-e8225d272999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Volume 00c20477-9d14-4199-a72a-c527bcf3e92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c20477-9d14-4199-a72a-c527bcf3e92b', 'volume_size': 1} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:19 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 Aug 17 16:35:19 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (1c4feb09-e9bd-4817-8db7-a0a8ac2778f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972e8887-2a82-49a1-ad9d-98ad3d783cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972e8887-2a82-49a1-ad9d-98ad3d783cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791406859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feffc17-8398-469e-85ed-a83930ed5356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:20Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112b80ee-0ce6-4f86-8cf4-bceadd087133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112b80ee-0ce6-4f86-8cf4-bceadd087133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03ce317-0285-4db8-bb4e-566eaedf376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03ce317-0285-4db8-bb4e-566eaedf376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7feffc17-8398-469e-85ed-a83930ed5356', 'volume_name': 'volume-7feffc17-8398-469e-85ed-a83930ed5356', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b2c39-07f8-4293-bc1a-9127ff8021f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358b2c39-07f8-4293-bc1a-9127ff8021f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35e0234-cf23-44cf-a4e5-c3f385ef4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Volume 7feffc17-8398-469e-85ed-a83930ed5356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7feffc17-8398-469e-85ed-a83930ed5356', 'volume_size': 1} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:19 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2" returned: 0 in 0.370s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-769687089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:18Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume 7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:20 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11b2fa2-27a8-4daa-b598-fcb3fd461786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e759be6-8847-4d25-9759-c2b298bb6aa2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fec8b58-e2c9-4651-9203-e0a0a523daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 1073741824 Aug 17 16:35:20 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Volume volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 (4e759be6-8847-4d25-9759-c2b298bb6aa2): created successfully Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fec8b58-e2c9-4651-9203-e0a0a523daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (1b1a3b77-b9b9-40dd-bfb3-094915098f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-23dcb1e3-03e5-4ace-9a97-632aa93d8859 tempest-CreateVolumesFromImageTest-78122985 None] Created volume successfully. Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (06fe09c1-fb82-402c-8d18-a22b029a0ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14b2282-05cb-49d6-802a-dbf2d232a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14b2282-05cb-49d6-802a-dbf2d232a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891115365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8dee00-6d07-4175-8691-cf2ef2895323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:20Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21f91b5-3675-4760-9c68-f75ed446e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21f91b5-3675-4760-9c68-f75ed446e3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c2d2fc-ae11-447a-b5cd-26f43df9f799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27c2d2fc-ae11-447a-b5cd-26f43df9f799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c8dee00-6d07-4175-8691-cf2ef2895323', 'volume_name': 'volume-7c8dee00-6d07-4175-8691-cf2ef2895323', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d5c68e-7036-4bef-aed7-983e42942e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d5c68e-7036-4bef-aed7-983e42942e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93c8b0f-4df3-47a7-9bb9-b3d7bdb542c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Volume 7c8dee00-6d07-4175-8691-cf2ef2895323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c8dee00-6d07-4175-8691-cf2ef2895323', 'volume_size': 1} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:20 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 1073741824" returned: 0 in 0.623s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:20 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 Aug 17 16:35:20 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:20 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" returned: 0 in 0.259s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.926s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990865773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc828cbc-cb2e-434a-b193-732c03f8de09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Creating volume bc828cbc-cb2e-434a-b193-732c03f8de09 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:20 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7494dca3-a234-4e1b-9083-e42f44c37cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:20 devstack sudo[113893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 1073741824 Aug 17 16:35:20 devstack sudo[113893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b809bef2-f5b9-4d67-b23a-d88211644d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 (7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0): created successfully Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b809bef2-f5b9-4d67-b23a-d88211644d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (50255b6e-1fbe-46cf-aa32-ef9084a92d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-288d75b4-1580-4d63-8e66-89176acceaf5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:21 devstack sudo[113893]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 1073741824" returned: 0 in 0.488s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:21 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 Aug 17 16:35:21 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:21 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09" returned: 0 in 0.295s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-845662319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86835952-e8c4-434f-adea-735eb0153710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06fc23e59896441aa0a8ac125e71a9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='e7593fc9ea62444296cc71b58b1a66a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Creating volume 86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:21 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 1073741824 Aug 17 16:35:21 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74aa7b72-7122-4dc5-8d77-0e9de7cf82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc828cbc-cb2e-434a-b193-732c03f8de09', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dba7533-af3a-4a7f-be5e-4f51c9fc85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Volume volume-bc828cbc-cb2e-434a-b193-732c03f8de09 (bc828cbc-cb2e-434a-b193-732c03f8de09): created successfully Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dba7533-af3a-4a7f-be5e-4f51c9fc85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (2dbeff33-595d-426e-981f-6b576af3f160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1ec18553-2551-41f5-a37e-cd3e9edccfa1 tempest-CreateVolumesFromImageTest-78122985 None] Created volume successfully. Aug 17 16:35:22 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (e3bd3e59-c2b2-48fb-8af1-373dea3fc50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331bb20f-9619-4ab7-8d40-af1ff3def0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 1073741824" returned: 0 in 0.525s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331bb20f-9619-4ab7-8d40-af1ff3def0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974724578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc34800-1049-4fe6-bbf0-b1ffdf442b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:22Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828deb5b-fff0-4d38-ac1d-cf8e0f4d4869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828deb5b-fff0-4d38-ac1d-cf8e0f4d4869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6905b5-b89e-4320-83e0-3d3a989dc4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6905b5-b89e-4320-83e0-3d3a989dc4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adc34800-1049-4fe6-bbf0-b1ffdf442b44', 'volume_name': 'volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f65902b-f46b-448f-ac0b-17e73ce721e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f65902b-f46b-448f-ac0b-17e73ce721e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0ec62-ddcd-4895-bd68-a9246cb4f97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume adc34800-1049-4fe6-bbf0-b1ffdf442b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44', 'volume_size': 1} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:22 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:22 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:22 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.311s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.167s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1111866370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c20477-9d14-4199-a72a-c527bcf3e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:19Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Creating volume 00c20477-9d14-4199-a72a-c527bcf3e92b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:22 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:22 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b 1073741824 Aug 17 16:35:22 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e1d150-1d7f-477e-9710-5c6d98244cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86835952-e8c4-434f-adea-735eb0153710', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e04bdf8-9d3f-41fa-970d-e1021387f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Flow 'volume_create_manager' (f4ae0f26-3df5-480f-8f29-4fba67d4675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484c2d1-f09b-43e1-9e5a-38aba472c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Volume volume-86835952-e8c4-434f-adea-735eb0153710 (86835952-e8c4-434f-adea-735eb0153710): created successfully Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e04bdf8-9d3f-41fa-970d-e1021387f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Flow 'volume_create_manager' (b518ccae-4bd4-4b36-a2cc-66a2f4c7d74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1484c2d1-f09b-43e1-9e5a-38aba472c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e21f51-12ed-4af3-8837-c0bec84938a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ede2ccbc93c4e938002970a4eac2de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='d46626ebcda74f8488efb7f73da20df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0941c87c-d630-4938-84d9-998127a00fe2),volume_type_id=0941c87c-d630-4938-84d9-998127a00fe2)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14753fe6-0c97-4888-a461-cbfc3d14c97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14753fe6-0c97-4888-a461-cbfc3d14c97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d275b0-202a-472e-ab51-8d7191fad5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:22 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:35:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-54affd55-7c46-4857-91ac-c64b6122a9bd tempest-VolumeDependencyTests-906763326 None] Created volume successfully. Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (86678e68-a8cc-414b-9610-433bef0f6625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488796f0-3a00-4267-8dfb-72902d15c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488796f0-3a00-4267-8dfb-72902d15c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518713308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e8b49d-bd4b-4b33-ad69-a4643f900a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3339e3-88ef-4421-ac3d-cf92836851b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a3339e3-88ef-4421-ac3d-cf92836851b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd22d16-0530-4e49-ab63-61f9e408ce85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd22d16-0530-4e49-ab63-61f9e408ce85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e8b49d-bd4b-4b33-ad69-a4643f900a0c', 'volume_name': 'volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb522ee2-45d6-4540-b1a2-42ecf00a0270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb522ee2-45d6-4540-b1a2-42ecf00a0270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928373e-86c7-43d7-aac7-d43d79e0c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume 51e8b49d-bd4b-4b33-ad69-a4643f900a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c', 'volume_size': 1} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (2f864fec-8851-4146-8c84-eca7f9d7f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6374e-9d53-49df-a68c-689f5a972df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e6374e-9d53-49df-a68c-689f5a972df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088251941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95fe5b3-7c77-4efa-a0d4-436466c7a1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e8e25-53cd-4ff4-a3df-52cbd996985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e8e25-53cd-4ff4-a3df-52cbd996985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a7e7a-b85e-451e-b25d-ac6fa906ad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348a7e7a-b85e-451e-b25d-ac6fa906ad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95fe5b3-7c77-4efa-a0d4-436466c7a1a7', 'volume_name': 'volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f191f019-0698-4457-88e0-4537470a77a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f191f019-0698-4457-88e0-4537470a77a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d3dc5e-f31f-426c-806d-4e9d459cefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume e95fe5b3-7c77-4efa-a0d4-436466c7a1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7', 'volume_size': 1} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:23 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b 1073741824" returned: 0 in 0.725s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d275b0-202a-472e-ab51-8d7191fad5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '74e21f51-12ed-4af3-8837-c0bec84938a4', 'volume_name': 'volume-74e21f51-12ed-4af3-8837-c0bec84938a4', 'volume_size': 1, 'image_id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a74881bf16e5bf2822351ecf2c66f678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ede2ccbc93c4e938002970a4eac2de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9768d9c9a3fb0f61a771656c6fa89796b30790f94997656b8e22776e5da99c871b8cc268ccf65ab569e552a28ee29a66d1428616d8313833a42db5710b54ee1', 'id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/543ade83-2b9c-404e-8ec3-8eefc99c9699/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a637fa6-7147-4f1e-8f38-2a1296623344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a637fa6-7147-4f1e-8f38-2a1296623344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550be6ac-5241-479e-9019-aa59f981967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Volume 74e21f51-12ed-4af3-8837-c0bec84938a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-74e21f51-12ed-4af3-8837-c0bec84938a4', 'volume_size': 1, 'image_id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a74881bf16e5bf2822351ecf2c66f678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ede2ccbc93c4e938002970a4eac2de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9768d9c9a3fb0f61a771656c6fa89796b30790f94997656b8e22776e5da99c871b8cc268ccf65ab569e552a28ee29a66d1428616d8313833a42db5710b54ee1', 'id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/543ade83-2b9c-404e-8ec3-8eefc99c9699/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Trying to clone 74e21f51-12ed-4af3-8837-c0bec84938a4 from image 543ade83-2b9c-404e-8ec3-8eefc99c9699 at location (None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:23 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b Aug 17 16:35:23 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:35:23 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Image download 0.00 MB at 0.00 MB/s Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6134c585-5667-4b00-a779-59b574bd3250]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (057a710d-d5ab-47b0-b7f9-dc7d7a8dd2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20606624-6ceb-4e62-baf1-e135326cacf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack sudo[113920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:23 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20606624-6ceb-4e62-baf1-e135326cacf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773509832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338b0a75-7d2a-4a93-b835-b9dbed466203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:24Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bc6bde-5d38-4eb1-99b4-39c1ad88e25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66bc6bde-5d38-4eb1-99b4-39c1ad88e25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d61d778-c059-469c-9308-ec3120ff7f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d61d778-c059-469c-9308-ec3120ff7f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '338b0a75-7d2a-4a93-b835-b9dbed466203', 'volume_name': 'volume-338b0a75-7d2a-4a93-b835-b9dbed466203', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d3f5c-9d55-421d-ad65-b90d4a6add8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35d3f5c-9d55-421d-ad65-b90d4a6add8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7714cdf-786c-44fb-9f1f-5c4ba8a81944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume 338b0a75-7d2a-4a93-b835-b9dbed466203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-338b0a75-7d2a-4a93-b835-b9dbed466203', 'volume_size': 1} Aug 17 16:35:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:24 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b" returned: 0 in 0.422s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.132s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791406859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7feffc17-8398-469e-85ed-a83930ed5356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:20Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Creating volume 7feffc17-8398-469e-85ed-a83930ed5356 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16755884-c05e-4900-a44e-e8225d272999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c20477-9d14-4199-a72a-c527bcf3e92b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 1073741824 Aug 17 16:35:24 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a047a3b-e479-4ca0-b242-c83b3cad4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Volume volume-00c20477-9d14-4199-a72a-c527bcf3e92b (00c20477-9d14-4199-a72a-c527bcf3e92b): created successfully Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a047a3b-e479-4ca0-b242-c83b3cad4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (8023cfda-4dbc-46b1-800f-47c3b9a0939d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:24 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7e4ad635-e82a-417b-baea-d9ce54a4bc18 tempest-CreateVolumesFromImageTest-78122985 None] Created volume successfully. Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (72dcf2dc-cd29-4401-a7c9-809cf9ef30eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821e5a71-5239-4d54-aa63-d3c3611e125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821e5a71-5239-4d54-aa63-d3c3611e125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567708381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874b9bfd-aa78-4342-83d2-30fd7e163261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:24Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b59ffd-5d78-4101-a9ab-7a030bd51811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b59ffd-5d78-4101-a9ab-7a030bd51811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a0caf2-d5dd-4166-9c2b-f55895f255a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a0caf2-d5dd-4166-9c2b-f55895f255a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874b9bfd-aa78-4342-83d2-30fd7e163261', 'volume_name': 'volume-874b9bfd-aa78-4342-83d2-30fd7e163261', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19971c49-d559-4a60-85c6-2ed0f05a53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19971c49-d559-4a60-85c6-2ed0f05a53fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:24 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c32db-4604-4701-9154-e8d3c00958e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume 874b9bfd-aa78-4342-83d2-30fd7e163261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874b9bfd-aa78-4342-83d2-30fd7e163261', 'volume_size': 1} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:24 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Temporary image 543ade83-2b9c-404e-8ec3-8eefc99c9699 is fetched for user d46626ebcda74f8488efb7f73da20df5. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:35:24 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 1073741824" returned: 0 in 0.458s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:24 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 Aug 17 16:35:24 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0125140c-9163-40ff-93a3-dba9277157a9]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:24 devstack sudo[113937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:24 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:24 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356" returned: 0 in 0.254s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.422s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891115365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c8dee00-6d07-4175-8691-cf2ef2895323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7f6373115d4a5a91a20948e269fc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:20Z,use_quota=True,user_id='00ebf33bd84845db8eb5dce17215b042',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Creating volume 7c8dee00-6d07-4175-8691-cf2ef2895323 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35e0234-cf23-44cf-a4e5-c3f385ef4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7feffc17-8398-469e-85ed-a83930ed5356', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 1073741824 Aug 17 16:35:24 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb6ff93-9ff5-473a-ac70-eb6321a2b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Volume volume-7feffc17-8398-469e-85ed-a83930ed5356 (7feffc17-8398-469e-85ed-a83930ed5356): created successfully Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb6ff93-9ff5-473a-ac70-eb6321a2b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (1c4feb09-e9bd-4817-8db7-a0a8ac2778f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a4bfcb5b-9756-41f3-80e2-246d18213a4c tempest-CreateVolumesFromImageTest-78122985 None] Created volume successfully. Aug 17 16:35:24 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:25 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:25 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:25 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 1073741824" returned: 0 in 0.447s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:25 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 Aug 17 16:35:25 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:25 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:25 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974724578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc34800-1049-4fe6-bbf0-b1ffdf442b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:22Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume adc34800-1049-4fe6-bbf0-b1ffdf442b44 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:25 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:25 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 1073741824 Aug 17 16:35:25 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93c8b0f-4df3-47a7-9bb9-b3d7bdb542c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c8dee00-6d07-4175-8691-cf2ef2895323', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2bff2-566c-46e0-af92-66f9134d3919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:25 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Volume volume-7c8dee00-6d07-4175-8691-cf2ef2895323 (7c8dee00-6d07-4175-8691-cf2ef2895323): created successfully Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2bff2-566c-46e0-af92-66f9134d3919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Flow 'volume_create_manager' (06fe09c1-fb82-402c-8d18-a22b029a0ee0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:25 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8ca45d67-c549-4e95-9bf0-7963e4cc6e8b tempest-CreateVolumesFromImageTest-78122985 None] Created volume successfully. Aug 17 16:35:25 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-7c8dee00-6d07-4175-8691-cf2ef2895323-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-7c8dee00-6d07-4175-8691-cf2ef2895323-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-quobyte-7c8dee00-6d07-4175-8691-cf2ef2895323" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-7c8dee00-6d07-4175-8691-cf2ef2895323" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[309ce34d-c1e6-4ac0-be56-6a4895e96aca]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:26 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 1073741824" returned: 0 in 0.531s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:26 devstack sudo[113961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 Aug 17 16:35:26 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:26 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 Aug 17 16:35:26 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:26 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44" returned: 0 in 0.269s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.213s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:26 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-518713308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e8b49d-bd4b-4b33-ad69-a4643f900a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume 51e8b49d-bd4b-4b33-ad69-a4643f900a0c {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:26 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:26 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c 1073741824 Aug 17 16:35:26 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e0ec62-ddcd-4895-bd68-a9246cb4f97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b783356-36fc-4e8a-9dfb-6903507588a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:26 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323 Aug 17 16:35:26 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 (adc34800-1049-4fe6-bbf0-b1ffdf442b44): created successfully Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b783356-36fc-4e8a-9dfb-6903507588a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (e3bd3e59-c2b2-48fb-8af1-373dea3fc50d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3c51c91c-417d-4e3e-9bf1-d313cd1f5e2d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:26 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7c8dee00-6d07-4175-8691-cf2ef2895323" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-7c8dee00-6d07-4175-8691-cf2ef2895323" released by "delete_volume" :: held 0.791s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Created reservations ['6896764e-fb4e-4e17-9d37-0e0cd8e89598', 'fd5b7e4a-42b7-4db3-8d99-ba6d926de5bb', '4a20cec0-461a-4788-b669-51f96fff3243', '32f1f4b9-805a-4561-a0b5-98b3f45803f2'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c 1073741824" returned: 0 in 0.519s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:27 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack sudo[113980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c Aug 17 16:35:27 devstack sudo[113980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-7feffc17-8398-469e-85ed-a83930ed5356-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-7feffc17-8398-469e-85ed-a83930ed5356-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-quobyte-7feffc17-8398-469e-85ed-a83930ed5356" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-7feffc17-8398-469e-85ed-a83930ed5356" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956e826-32fa-4d35-83f0-53f77287dbff]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack sudo[113980]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" returned: 0 in 0.290s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.965s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1088251941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95fe5b3-7c77-4efa-a0d4-436466c7a1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:27 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0928373e-86c7-43d7-aac7-d43d79e0c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:27 devstack sudo[113985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 1073741824 Aug 17 16:35:27 devstack sudo[113985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c5a23-f535-4529-a08f-f183c4fd3085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Deleted volume successfully. Aug 17 16:35:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c (51e8b49d-bd4b-4b33-ad69-a4643f900a0c): created successfully Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c5a23-f535-4529-a08f-f183c4fd3085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (86678e68-a8cc-414b-9610-433bef0f6625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:27 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 Aug 17 16:35:27 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bbce3f08-d710-41d9-bc68-101c81a69818 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4cb0fb35-08fa-4e53-af93-5fef8b4f35c7 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-7c8dee00-6d07-4175-8691-cf2ef2895323-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:27 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356" returned: 0 in 0.388s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356 Aug 17 16:35:27 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack sudo[113985]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 1073741824" returned: 0 in 0.471s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:27 devstack sudo[113997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 Aug 17 16:35:27 devstack sudo[113997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:27 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7feffc17-8398-469e-85ed-a83930ed5356" returned: 0 in 0.255s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-7feffc17-8398-469e-85ed-a83930ed5356" released by "delete_volume" :: held 0.709s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Created reservations ['7f05b964-236c-470c-962f-691d8d6fb278', '1ae95294-ae2b-4e60-af77-88d8562e1a6b', '6a12de9c-1f2b-4d70-84ac-4e6863e37cf3', 'a1189743-3fb3-4b0e-8746-65df1e394ec0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:28 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:28 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:28 devstack sudo[113997]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.588s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d3dc5e-f31f-426c-806d-4e9d459cefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d584869-43ee-4df8-97f7-69302f503fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Creating offline snapshot ab48e082-18a5-43fd-b734-b075b44ff813 of volume 86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:35:28 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 (e95fe5b3-7c77-4efa-a0d4-436466c7a1a7): created successfully Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d584869-43ee-4df8-97f7-69302f503fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (2f864fec-8851-4146-8c84-eca7f9d7f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e89473-6253-43a9-b618-9da3c9a1ab97]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-43e8400f-1139-4561-9c6c-4087d42e22a5 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:28 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:28 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:28 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:28 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Deleted volume successfully. Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-00c20477-9d14-4199-a72a-c527bcf3e92b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-00c20477-9d14-4199-a72a-c527bcf3e92b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f2263a7-3fc3-40fb-8e99-864996d2fa92 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-7feffc17-8398-469e-85ed-a83930ed5356-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-quobyte-00c20477-9d14-4199-a72a-c527bcf3e92b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-00c20477-9d14-4199-a72a-c527bcf3e92b" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3abe21-ee23-4acb-b022-05f8c513ca3c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:28 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.431s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:28 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b Aug 17 16:35:28 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:28 devstack sudo[114010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 1G Aug 17 16:35:28 devstack sudo[114010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:28 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b" returned: 0 in 0.408s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b Aug 17 16:35:29 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:29 devstack sudo[114010]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 1G" returned: 0 in 0.426s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86835952-e8c4-434f-adea-735eb0153710 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack sudo[114021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86835952-e8c4-434f-adea-735eb0153710 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:29 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:29 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-00c20477-9d14-4199-a72a-c527bcf3e92b" returned: 0 in 0.279s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-00c20477-9d14-4199-a72a-c527bcf3e92b" released by "delete_volume" :: held 0.726s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Created reservations ['d91b3f45-82e5-4882-aaff-d1bfe51ccda2', '8943be77-08f2-4fc0-bc97-f044a43ffcab', '2d54773e-3606-4c02-8361-3e06c4fd6f25', 'add87924-f26a-4852-a624-4d0a71161971'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:29 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:29 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86835952-e8c4-434f-adea-735eb0153710 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.338s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:29 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 is being set with open permissions: ugo+rw Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack sudo[114029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:29 devstack sudo[114029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:29 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-bc828cbc-cb2e-434a-b193-732c03f8de09-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Deleted volume successfully. Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-bc828cbc-cb2e-434a-b193-732c03f8de09-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b3d63ec4-84bf-4428-b8b4-3730bd6c8fd5 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-00c20477-9d14-4199-a72a-c527bcf3e92b-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-quobyte-bc828cbc-cb2e-434a-b193-732c03f8de09" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:29 devstack sudo[114029]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-bc828cbc-cb2e-434a-b193-732c03f8de09" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d63cc28-4eb9-4b6f-8e5b-7a877bab4e2c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:29 devstack sudo[114034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info Aug 17 16:35:29 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:29 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 Aug 17 16:35:29 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:30 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info is being set with open permissions: ugo+rw Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:30 devstack sudo[114038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info Aug 17 16:35:30 devstack sudo[114038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:30 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09" returned: 0 in 0.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:30 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09 Aug 17 16:35:30 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:30 devstack sudo[114038]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.info" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.438s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773509832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=338b0a75-7d2a-4a93-b835-b9dbed466203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:24Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume 338b0a75-7d2a-4a93-b835-b9dbed466203 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:30 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:30 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 1073741824 Aug 17 16:35:30 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6c0fac06-a530-479b-95d3-48b4235103cc tempest-VolumeDependencyTests-906763326 None] Create snapshot completed successfully Aug 17 16:35:30 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bc828cbc-cb2e-434a-b193-732c03f8de09" returned: 0 in 0.270s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-bc828cbc-cb2e-434a-b193-732c03f8de09" released by "delete_volume" :: held 0.711s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Created reservations ['da904eef-1da6-4587-b55c-addd73234a02', 'cef799eb-57ab-4839-99ee-14cbdc0b91d4', '4c3f35f5-48d0-4f10-a5f4-e1bca58ca32c', 'e0bcb65d-4c54-4e7b-bf94-5dadf8ea1691'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:30 devstack sudo[114053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:30 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-4e759be6-8847-4d25-9759-c2b298bb6aa2-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-4e759be6-8847-4d25-9759-c2b298bb6aa2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "cinder-quobyte-4e759be6-8847-4d25-9759-c2b298bb6aa2" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:30 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.360s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Deleted volume successfully. Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 1073741824" returned: 0 in 0.610s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:30 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-4e759be6-8847-4d25-9759-c2b298bb6aa2" acquired by "delete_volume" :: waited 0.044s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-bb96d414-389a-4cec-b3df-bf2527bdd435 tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-bc828cbc-cb2e-434a-b193-732c03f8de09-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a69c66-2ad7-440e-b072-606c55f29d1a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 Aug 17 16:35:31 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:31 devstack sudo[114062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 Aug 17 16:35:31 devstack sudo[114062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:31 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.115s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567708381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874b9bfd-aa78-4342-83d2-30fd7e163261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea0b193f36a4db688a6057678826487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:24Z,use_quota=True,user_id='7b35372c2b2443c08d09416c6e7d6d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Creating volume 874b9bfd-aa78-4342-83d2-30fd7e163261 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:31 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack sudo[114062]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7714cdf-786c-44fb-9f1f-5c4ba8a81944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-338b0a75-7d2a-4a93-b835-b9dbed466203', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 1073741824 Aug 17 16:35:31 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b439b3-1a79-4bc6-b6db-efa257b0c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2" returned: 0 in 0.437s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-338b0a75-7d2a-4a93-b835-b9dbed466203 (338b0a75-7d2a-4a93-b835-b9dbed466203): created successfully Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6b439b3-1a79-4bc6-b6db-efa257b0c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack sudo[114073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2 Aug 17 16:35:31 devstack sudo[114073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (057a710d-d5ab-47b0-b7f9-dc7d7a8dd2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f8354c9e-f5c7-49f7-951a-72ed0872448f tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Flow 'volume_create_manager' (5129d95f-5ba6-4f1e-92a2-750a7ae3b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15728d21-7c08-4855-b209-7b6be15eb444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15728d21-7c08-4855-b209-7b6be15eb444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1091413289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fd0f91e-e446-47fc-a810-ab9d07f4e0d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06fc23e59896441aa0a8ac125e71a9dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab48e082-18a5-43fd-b734-b075b44ff813,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:31Z,use_quota=True,user_id='e7593fc9ea62444296cc71b58b1a66a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07886c75-b6a9-44ca-923d-d8973f49a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07886c75-b6a9-44ca-923d-d8973f49a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f9c699-fe87-4ec8-aad0-78b39a7dd487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f9c699-fe87-4ec8-aad0-78b39a7dd487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fd0f91e-e446-47fc-a810-ab9d07f4e0d8', 'volume_name': 'volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8', 'volume_size': 1, 'snapshot_id': 'ab48e082-18a5-43fd-b734-b075b44ff813'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07776b45-61f1-4705-b910-e2e07c0403f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07776b45-61f1-4705-b910-e2e07c0403f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1848a12f-2445-4c17-86db-10daa956c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Volume 4fd0f91e-e446-47fc-a810-ab9d07f4e0d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8', 'volume_size': 1, 'snapshot_id': 'ab48e082-18a5-43fd-b734-b075b44ff813'} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:31 devstack sudo[114073]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4e759be6-8847-4d25-9759-c2b298bb6aa2" returned: 0 in 0.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-quobyte-4e759be6-8847-4d25-9759-c2b298bb6aa2" released by "delete_volume" :: held 0.783s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Created reservations ['16c0cf36-3839-487c-b51d-c7b7f949dae9', '98256535-99ee-4ba6-9029-ac5b7534914a', '65812b40-730c-4094-b0bd-32463ca78c82', 'faa828f4-b4d3-4e03-88cc-31e91e0e2d9b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 1073741824" returned: 0 in 0.505s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:31 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:31 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:31 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 Aug 17 16:35:31 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:32 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.285s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Deleted volume successfully. Aug 17 16:35:32 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261" returned: 0 in 0.269s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.848s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e21f51-12ed-4af3-8837-c0bec84938a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ede2ccbc93c4e938002970a4eac2de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:23Z,use_quota=True,user_id='d46626ebcda74f8488efb7f73da20df5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0941c87c-d630-4938-84d9-998127a00fe2),volume_type_id=0941c87c-d630-4938-84d9-998127a00fe2)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Creating volume 74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:32 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71c32db-4604-4701-9154-e8d3c00958e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874b9bfd-aa78-4342-83d2-30fd7e163261', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534b706e-b638-46a4-af16-b87cd126f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:32 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1073741824 Aug 17 16:35:32 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce1758ff-e7ce-4953-b997-188c16d7914b tempest-CreateVolumesFromImageTest-78122985 None] Lock "cinder-4e759be6-8847-4d25-9759-c2b298bb6aa2-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Volume volume-874b9bfd-aa78-4342-83d2-30fd7e163261 (874b9bfd-aa78-4342-83d2-30fd7e163261): created successfully Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534b706e-b638-46a4-af16-b87cd126f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Flow 'volume_create_manager' (72dcf2dc-cd29-4401-a7c9-809cf9ef30eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-43da05cf-372c-4475-b140-ae7c73fa0546 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created volume successfully. Aug 17 16:35:32 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1073741824" returned: 0 in 0.520s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:32 devstack sudo[114092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 Aug 17 16:35:32 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-874b9bfd-aa78-4342-83d2-30fd7e163261-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-874b9bfd-aa78-4342-83d2-30fd7e163261-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-874b9bfd-aa78-4342-83d2-30fd7e163261" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:33 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4" returned: 0 in 0.336s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-874b9bfd-aa78-4342-83d2-30fd7e163261" acquired by "delete_volume" :: waited 0.046s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.518s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d05e9-4e89-47b2-bd0c-bb4cbcc8633d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Creating volume 4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 from snapshot ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] snapshot: ab48e082-18a5-43fd-b734-b075b44ff813, volume: 4fd0f91e-e446-47fc-a810-ab9d07f4e0d8, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Attempting download of 543ade83-2b9c-404e-8ec3-8eefc99c9699 ((None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}])) to volume 74e21f51-12ed-4af3-8837-c0bec84938a4. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bf870a-c053-4b1f-905f-7ba0ecd76f32]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b05bca0-12b3-41f8-821b-ec1ff70f8249]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:33 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 Aug 17 16:35:33 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:33 devstack sudo[114099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv Aug 17 16:35:33 devstack sudo[114099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:33 devstack sudo[114097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:33 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:33 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261" returned: 0 in 0.555s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:33 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261 Aug 17 16:35:33 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:33 devstack sudo[114099]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv" returned: 0 in 0.484s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:33 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.612s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86835952-e8c4-434f-adea-735eb0153710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea5e85-c794-472c-bd9c-b3bd14a132ac]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:34 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv Aug 17 16:35:34 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:34 devstack sudo[114149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:34 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:34 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-874b9bfd-aa78-4342-83d2-30fd7e163261" returned: 0 in 0.401s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-874b9bfd-aa78-4342-83d2-30fd7e163261" released by "delete_volume" :: held 1.053s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:34 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv" returned: 1 in 0.486s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_543ade83-2b9c-404e-8ec3-8eefc99c9699_icvu_5nv' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e8ce57-e4ee-4c61-a860-262d48ed25f9]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['68820412-ad39-4fcc-8811-b733e296dfc1', '6ba0afcd-ecfc-45f8-a29d-6d5d97be107f', '4c12b278-c63d-4335-a7df-ece12b3e32ef', 'dcd8625f-366b-41ba-8de2-00fa5ed64040'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:34 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:34 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:34 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.555s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:35:34 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:34 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:34 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 Aug 17 16:35:34 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:34 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:34 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f1d9b9ad-5eeb-46a3-907e-4701a702902d tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-874b9bfd-aa78-4342-83d2-30fd7e163261-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:34 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD Aug 17 16:35:34 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:35 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] 543ade83-2b9c-404e-8ec3-8eefc99c9699 was raw, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:35 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 Aug 17 16:35:35 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-338b0a75-7d2a-4a93-b835-b9dbed466203-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-338b0a75-7d2a-4a93-b835-b9dbed466203-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-338b0a75-7d2a-4a93-b835-b9dbed466203" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-338b0a75-7d2a-4a93-b835-b9dbed466203" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[444284e7-a42c-47ad-93e1-5ebb1492abaf]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:36 devstack sudo[114187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 Aug 17 16:35:36 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:36 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4" returned: 0 in 1.417s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:36 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_543ade83-2b9c-404e-8ec3-8eefc99c9699_czifttgxdevstack@QuobyteHD, size 0.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:35:36 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 16:35:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:36 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203" returned: 0 in 0.827s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:36 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1G Aug 17 16:35:36 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:36 devstack sudo[114198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203 Aug 17 16:35:36 devstack sudo[114198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:37 devstack sudo[114198]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-338b0a75-7d2a-4a93-b835-b9dbed466203" returned: 0 in 0.592s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-338b0a75-7d2a-4a93-b835-b9dbed466203" released by "delete_volume" :: held 1.543s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['7d42eb8e-2ee3-421e-ae9e-4c414012fa3f', 'af1e0078-f103-4858-85bf-09f78b5852df', '2720c038-a011-48d0-91d5-12e412f6ec9b', 'e0236b8d-23f9-41f8-bcf6-7ca3fe9d7eda'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:37 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 1G" returned: 0 in 0.982s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Downloaded image 543ade83-2b9c-404e-8ec3-8eefc99c9699 ((None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}])) to volume 74e21f51-12ed-4af3-8837-c0bec84938a4 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Temporary image 543ade83-2b9c-404e-8ec3-8eefc99c9699 for user d46626ebcda74f8488efb7f73da20df5 is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Marking volume 74e21f51-12ed-4af3-8837-c0bec84938a4 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Copying metadata from image 543ade83-2b9c-404e-8ec3-8eefc99c9699 to 74e21f51-12ed-4af3-8837-c0bec84938a4. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Creating volume glance metadata for volume 74e21f51-12ed-4af3-8837-c0bec84938a4 backed by image 543ade83-2b9c-404e-8ec3-8eefc99c9699 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a74881bf16e5bf2822351ecf2c66f678', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:38 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:38 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (550be6ac-5241-479e-9019-aa59f981967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e21f51-12ed-4af3-8837-c0bec84938a4', 'volume_size': 1, 'image_id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/543ade83-2b9c-404e-8ec3-8eefc99c9699', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a74881bf16e5bf2822351ecf2c66f678', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ede2ccbc93c4e938002970a4eac2de3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9768d9c9a3fb0f61a771656c6fa89796b30790f94997656b8e22776e5da99c871b8cc268ccf65ab569e552a28ee29a66d1428616d8313833a42db5710b54ee1', 'id': '543ade83-2b9c-404e-8ec3-8eefc99c9699', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/543ade83-2b9c-404e-8ec3-8eefc99c9699/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7347e4a-6c2f-4234-86a1-3376dc4e3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Volume volume-74e21f51-12ed-4af3-8837-c0bec84938a4 (74e21f51-12ed-4af3-8837-c0bec84938a4): created successfully Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7347e4a-6c2f-4234-86a1-3376dc4e3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Flow 'volume_create_manager' (f4ae0f26-3df5-480f-8f29-4fba67d4675c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1e9a4def-25d4-47d2-abfa-56a1e4e41fd0 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Created volume successfully. Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ad972-0db1-432b-8f9c-e8dba4734472]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:38 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.688s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f0e130b2-a630-41df-bd19-0c51735fc265 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-338b0a75-7d2a-4a93-b835-b9dbed466203-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:38 devstack sudo[114207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 Aug 17 16:35:38 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Acquiring lock "cinder-74e21f51-12ed-4af3-8837-c0bec84938a4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "cinder-74e21f51-12ed-4af3-8837-c0bec84938a4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:39 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" returned: 0 in 0.900s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Acquiring lock "cinder-quobyte-74e21f51-12ed-4af3-8837-c0bec84938a4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:39 devstack sudo[114212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7 Aug 17 16:35:39 devstack sudo[114212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "cinder-quobyte-74e21f51-12ed-4af3-8837-c0bec84938a4" acquired by "delete_volume" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[28548c38-7ac5-469b-93df-6b25d88dc780]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:40 devstack sudo[114214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 Aug 17 16:35:40 devstack sudo[114214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:40 devstack sudo[114212]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" returned: 0 in 0.730s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7" released by "delete_volume" :: held 1.786s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['c3f40960-163b-4f67-8bb3-04a3546387b5', '3f10909b-5c98-4135-9ae6-4bd71753e38e', 'a905eb68-24d8-4df8-a75b-727456f7103a', 'c327701c-79a6-42d4-a510-d4326b5d448f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" returned: 0 in 5.944s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:35:40 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Converted 1024.00 MB image at 172.20 MB/s Aug 17 16:35:40 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 is being set with open permissions: ugo+rw Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:40 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 Aug 17 16:35:40 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:40 devstack sudo[114214]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4" returned: 0 in 0.908s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:40 devstack sudo[114222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:40 devstack sudo[114222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:40 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4 Aug 17 16:35:40 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:40 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" returned: 0 in 0.363s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" released by "_copy_volume_from_snapshot" :: held 7.608s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:40 devstack sudo[114222]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.374s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" released by "_create_volume_from_snapshot" :: held 7.728s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.761s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1848a12f-2445-4c17-86db-10daa956c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8', 'volume_size': 1, 'snapshot_id': 'ab48e082-18a5-43fd-b734-b075b44ff813'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:40 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d83586-988d-4757-8628-c3c52627480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Volume volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 (4fd0f91e-e446-47fc-a810-ab9d07f4e0d8): created successfully Aug 17 16:35:41 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d83586-988d-4757-8628-c3c52627480d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Flow 'volume_create_manager' (5129d95f-5ba6-4f1e-92a2-750a7ae3b87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-366303a8-8db7-4b81-b221-9d8e4233b469 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-e95fe5b3-7c77-4efa-a0d4-436466c7a1a7-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-74e21f51-12ed-4af3-8837-c0bec84938a4" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "cinder-quobyte-74e21f51-12ed-4af3-8837-c0bec84938a4" released by "delete_volume" :: held 1.407s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-342b5d59-d9e4-4489-b8cd-e568036c9558 tempest-VolumeDependencyTests-906763326 None] Created volume successfully. Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Created reservations ['10ee4ca7-b08b-4255-b74d-47149ab37525', 'ede7b9ea-f196-42ac-8363-48d31685fabb', 'cf868c3d-b192-4c44-a3fd-249c3714ad78', '5cc1e471-5054-4fce-a897-42d72db17c3f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:41 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:41 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-51e8b49d-bd4b-4b33-ad69-a4643f900a0c-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-51e8b49d-bd4b-4b33-ad69-a4643f900a0c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:41 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.287s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b890d82-ff22-4d66-af6f-9acebf047796]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Deleted volume successfully. Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-86def3c5-9f8b-444f-a0ec-ac3387f4f635 tempest-VolumeAndVolumeTypeFromImageTest-527238582 None] Lock "cinder-74e21f51-12ed-4af3-8837-c0bec84938a4-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:41 devstack sudo[114232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c Aug 17 16:35:41 devstack sudo[114232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-ab48e082-18a5-43fd-b734-b075b44ff813-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-ab48e082-18a5-43fd-b734-b075b44ff813-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Deleting offline snapshot ab48e082-18a5-43fd-b734-b075b44ff813 of volume 86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] snapshot_file for this snap is: volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:35:41 devstack sudo[114232]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" returned: 0 in 0.507s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d6c431-13f7-4113-9ed3-0a5775f395cf]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:42 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c Aug 17 16:35:42 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:42 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:42 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:42 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" returned: 0 in 0.340s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-51e8b49d-bd4b-4b33-ad69-a4643f900a0c" released by "delete_volume" :: held 0.916s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['a3d668da-e726-47df-a132-01a19e5af020', '87709ce6-0c15-48c6-92ca-c6d60dbb2c2b', 'aade51e9-406a-4e46-88ef-5dd20f0abadb', '3a19a287-38d8-4dca-8443-a75cf1b4bdfb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:42 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.497s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86835952-e8c4-434f-adea-735eb0153710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc29729-8058-4123-83a5-dd863c507af1]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-adc34800-1049-4fe6-bbf0-b1ffdf442b44-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:42 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:42 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-adc34800-1049-4fe6-bbf0-b1ffdf442b44-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-adc34800-1049-4fe6-bbf0-b1ffdf442b44" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:42 devstack sudo[114246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:42 devstack sudo[114246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-adc34800-1049-4fe6-bbf0-b1ffdf442b44" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8307c7ba-6b98-4497-9ee5-2321adf78391]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:43 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 Aug 17 16:35:43 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:43 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.407s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-272cfc78-8a69-4fce-990c-936769126a46 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-51e8b49d-bd4b-4b33-ad69-a4643f900a0c-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:43 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:43 devstack sudo[114259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44 Aug 17 16:35:43 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:43 devstack sudo[114246]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.879s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:43 devstack sudo[114261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:43 devstack sudo[114261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:43 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-adc34800-1049-4fe6-bbf0-b1ffdf442b44" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-adc34800-1049-4fe6-bbf0-b1ffdf442b44" released by "delete_volume" :: held 0.963s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:43 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['df912b2e-99bf-4ecb-9230-be9f556d408d', 'eb96b78d-f481-45d1-b7ec-85ebb55cec77', 'fe29233b-2d60-4d4e-94cf-abfafe48a1cb', '00106314-de48-46e9-977f-90d1c00b1f85'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:44 devstack sudo[114261]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.607s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:44 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:44 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:44 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813 Aug 17 16:35:44 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:44 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.352s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:44 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710.ab48e082-18a5-43fd-b734-b075b44ff813" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-8d17a5d2-31dc-4ded-84d4-d20401993563 tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-adc34800-1049-4fe6-bbf0-b1ffdf442b44-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-ab48e082-18a5-43fd-b734-b075b44ff813" released by "_delete_snapshot" :: held 2.554s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" released by "delete_snapshot" :: held 2.598s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Created reservations ['0bdaf9ae-fd71-4180-b586-8fa450c2c715', 'ba684e1c-2fd6-4630-93f3-eb3444756d80', '45fa2948-1892-466e-b733-ddde50738a8b', '09864bb0-04ba-46b3-8db9-bb56e2b03e04'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:44 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Delete snapshot completed successfully. Aug 17 16:35:44 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-fd226eae-e39a-496b-98a0-535fd35a1723 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-ab48e082-18a5-43fd-b734-b075b44ff813-delete_snapshot" released by "delete_snapshot" :: held 2.788s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-86835952-e8c4-434f-adea-735eb0153710-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "cinder-quobyte-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "cinder-86835952-e8c4-434f-adea-735eb0153710-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa6ffcd-5e80-4d55-926f-7f6605e12b74]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa32ce7-ef11-454f-b9a8-16e7b0d0176b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:45 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 Aug 17 16:35:45 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:45 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:45 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:45 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" returned: 0 in 0.463s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:45 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0 Aug 17 16:35:45 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:45 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.528s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:45 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710 Aug 17 16:35:45 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:46 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" returned: 0 in 0.358s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-quobyte-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0" released by "delete_volume" :: held 0.893s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Created reservations ['95f33baa-61eb-42a8-b781-eedbfc14ec61', '6af5411d-2f01-40d0-8b42-9e2323d8e70f', '8c76657c-aef7-47e5-ba28-3d3a42889eef', '3259f722-538b-47cc-8a99-09cb52ea70cb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:46 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-86835952-e8c4-434f-adea-735eb0153710" returned: 0 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:46 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:46 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-86835952-e8c4-434f-adea-735eb0153710" released by "delete_volume" :: held 1.060s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Created reservations ['2967c23e-2782-42df-9539-478417af228f', '7599f134-48fe-41bb-b205-66d4311dd0cb', '1e3bfeb7-60ee-4d44-90f5-b89eab6fbd4d', 'f829d55b-a0a5-4a69-bc49-c15ce649fcda'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:46 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:46 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:46 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (478c98b6-7831-4b2c-8510-7256c8fe9003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c32850-9ef1-476f-b536-7f9f3a0d588e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.441s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Deleted volume successfully. Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c32850-9ef1-476f-b536-7f9f3a0d588e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337565706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2c7af0-213a-41b4-baeb-78e531b95585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:47Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:46 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:46 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8a1e40-ac87-4399-9fcc-5e231cf5e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8a1e40-ac87-4399-9fcc-5e231cf5e12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad1b01e-0584-414e-849e-4b6173b8e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad1b01e-0584-414e-849e-4b6173b8e990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2c7af0-213a-41b4-baeb-78e531b95585', 'volume_name': 'volume-4c2c7af0-213a-41b4-baeb-78e531b95585', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba24c45b-5440-455d-a476-db004e786481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba24c45b-5440-455d-a476-db004e786481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7b3fae-9a8d-412b-831a-ccd17d7839b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:46 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Volume 4c2c7af0-213a-41b4-baeb-78e531b95585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2c7af0-213a-41b4-baeb-78e531b95585', 'volume_size': 1} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-337565706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2c7af0-213a-41b4-baeb-78e531b95585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:47Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Creating volume 4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:46 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:46 devstack sudo[114298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 1073741824 Aug 17 16:35:46 devstack sudo[114298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e55476ec-9fa5-4993-b417-6372a394efae tempest-CreateVolumesFromSourceVolumeTest-1658566739 None] Lock "cinder-7d1ae6e6-4c2b-4a58-adcb-fa306a0403e0-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:47 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.301s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:35:47 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.467s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Deleted volume successfully. Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5c893f41-157f-430b-a80a-004fe2c5ceba tempest-VolumeDependencyTests-906763326 None] Lock "cinder-86835952-e8c4-434f-adea-735eb0153710-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:47 devstack sudo[114298]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 1073741824" returned: 0 in 0.667s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:47 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 Aug 17 16:35:47 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" acquired by "delete_volume" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb056365-5981-42f8-b0c0-19adcdf90422]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:47 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 Aug 17 16:35:47 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:47 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585" returned: 0 in 0.313s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7b3fae-9a8d-412b-831a-ccd17d7839b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2c7af0-213a-41b4-baeb-78e531b95585', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31149ae-f123-4335-8298-a95b3f11ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:47 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Volume volume-4c2c7af0-213a-41b4-baeb-78e531b95585 (4c2c7af0-213a-41b4-baeb-78e531b95585): created successfully Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31149ae-f123-4335-8298-a95b3f11ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (478c98b6-7831-4b2c-8510-7256c8fe9003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:47 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-162cdfa0-c93e-4269-9b00-ea0ce597f756 tempest-ProjectReaderTests-473592646 None] Created volume successfully. Aug 17 16:35:48 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:48 devstack sudo[114314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8 Aug 17 16:35:48 devstack sudo[114314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (d171fac1-b479-42ff-8833-65eeaac1e153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2635cf4-1640-41a7-85d2-1423df3e597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2635cf4-1640-41a7-85d2-1423df3e597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15315830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e7f7d-09e3-4088-8049-5252f0fb31da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:48Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1406d87f-7c0a-44b5-9051-300309afbf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1406d87f-7c0a-44b5-9051-300309afbf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:48 devstack sudo[114314]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0542e0-ab5e-4990-b86e-5a3b78da50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0542e0-ab5e-4990-b86e-5a3b78da50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315e7f7d-09e3-4088-8049-5252f0fb31da', 'volume_name': 'volume-315e7f7d-09e3-4088-8049-5252f0fb31da', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e0a9c8-af9d-4f87-913c-b7b0a09b45f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e0a9c8-af9d-4f87-913c-b7b0a09b45f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a624714b-5849-4c39-8b78-49c4cb10b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:48 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume 315e7f7d-09e3-4088-8049-5252f0fb31da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315e7f7d-09e3-4088-8049-5252f0fb31da', 'volume_size': 1} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-15315830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315e7f7d-09e3-4088-8049-5252f0fb31da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:48Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume 315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:48 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" returned: 0 in 0.336s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-quobyte-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8" released by "delete_volume" :: held 0.855s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:48 devstack sudo[114317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da 1073741824 Aug 17 16:35:48 devstack sudo[114317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Created reservations ['d1c90bfc-c720-4b8f-bf50-c790c0a32600', '7f0a5ccd-381c-48ce-8d0d-bdca908eb411', '4da2b751-3dd3-4c91-8342-3eb26787619f', '136d1e23-c701-4dce-93bf-859fbf43b554'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:48 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:48 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:49 devstack sudo[114317]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da 1073741824" returned: 0 in 0.567s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:49 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Deleted volume successfully. Aug 17 16:35:49 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da Aug 17 16:35:49 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b895733d-48ed-44fc-a483-14304e2e22a9 tempest-VolumeDependencyTests-906763326 None] Lock "cinder-4fd0f91e-e446-47fc-a810-ab9d07f4e0d8-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:49 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da" returned: 0 in 0.267s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a624714b-5849-4c39-8b78-49c4cb10b754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315e7f7d-09e3-4088-8049-5252f0fb31da', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe6c5f9-2095-4250-8c4d-796c6c80c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Creating offline snapshot c4517233-3436-4e0f-bfa2-410b22c28cd0 of volume 4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:35:49 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-315e7f7d-09e3-4088-8049-5252f0fb31da (315e7f7d-09e3-4088-8049-5252f0fb31da): created successfully Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe6c5f9-2095-4250-8c4d-796c6c80c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (d171fac1-b479-42ff-8833-65eeaac1e153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[554b1c04-ae1a-49c2-8714-58a2fceeb3e5]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d4a648e9-c3e8-4b95-958f-e539d6a26771 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:35:49 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 Aug 17 16:35:49 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:49 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:49 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 1G Aug 17 16:35:49 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:50 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 1G" returned: 0 in 0.463s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2c7af0-213a-41b4-baeb-78e531b95585 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:50 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2c7af0-213a-41b4-baeb-78e531b95585 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 Aug 17 16:35:50 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:50 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2c7af0-213a-41b4-baeb-78e531b95585 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0" returned: 0 in 0.363s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:50 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 is being set with open permissions: ugo+rw Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:50 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 Aug 17 16:35:50 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:50 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0" returned: 0 in 0.294s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:50 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info Aug 17 16:35:50 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:51 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info" returned: 0 in 0.262s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:51 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info is being set with open permissions: ugo+rw Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:51 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info Aug 17 16:35:51 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:51 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.info" returned: 0 in 0.280s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.827s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating offline snapshot 339b79b9-b59d-4d97-996d-1509fd6c9e40 of volume 315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:35:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-06121b05-4810-45eb-9ff4-a118f62f3e50 tempest-ProjectReaderTests-473592646 None] Create snapshot completed successfully Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d256c-c236-4003-b230-acde7032941f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:51 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da Aug 17 16:35:51 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:52 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da" returned: 0 in 0.488s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:52 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 1G Aug 17 16:35:52 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-c4517233-3436-4e0f-bfa2-410b22c28cd0-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-c4517233-3436-4e0f-bfa2-410b22c28cd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-c4517233-3436-4e0f-bfa2-410b22c28cd0" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-c4517233-3436-4e0f-bfa2-410b22c28cd0" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Deleting offline snapshot c4517233-3436-4e0f-bfa2-410b22c28cd0 of volume 4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] snapshot_file for this snap is: volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b7211-06eb-4ad6-b1a8-f6d41a2ca666]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:52 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 Aug 17 16:35:52 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:52 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 1G" returned: 0 in 0.597s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315e7f7d-09e3-4088-8049-5252f0fb31da -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:52 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315e7f7d-09e3-4088-8049-5252f0fb31da -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 Aug 17 16:35:52 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:52 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0" returned: 0 in 0.407s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c2c7af0-213a-41b4-baeb-78e531b95585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b7441-e19c-4fd5-b432-9de50362e49d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-315e7f7d-09e3-4088-8049-5252f0fb31da -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40" returned: 0 in 0.345s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:53 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 is being set with open permissions: ugo+rw Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 Aug 17 16:35:53 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 Aug 17 16:35:53 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40" returned: 0 in 0.254s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info Aug 17 16:35:53 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585" returned: 0 in 0.408s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 Aug 17 16:35:53 devstack sudo[114389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info" returned: 0 in 0.309s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:53 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info is being set with open permissions: ugo+rw Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info Aug 17 16:35:53 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114389]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0" returned: 0 in 0.474s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:53 devstack sudo[114398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0 Aug 17 16:35:53 devstack sudo[114398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:53 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.info" returned: 0 in 0.334s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4dd6f1b5-52fa-404b-b2d9-6ced729c751c tempest-CreateVolumesFromSnapshotTest-868343313 None] Create snapshot completed successfully Aug 17 16:35:54 devstack sudo[114398]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585.c4517233-3436-4e0f-bfa2-410b22c28cd0" returned: 0 in 0.327s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-c4517233-3436-4e0f-bfa2-410b22c28cd0" released by "_delete_snapshot" :: held 1.746s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" released by "delete_snapshot" :: held 1.791s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Created reservations ['c8d5905f-9025-40c2-8a74-299868cbbe89', '4162ae5e-c800-4993-9d85-f50cf71489fb', '37926e3d-4d44-421f-8c88-937f82c93137', '91146e28-dce4-41ea-b0fb-5c2a8fc79cfa'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Delete snapshot completed successfully. Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-f4d0a9c6-a89e-4687-ac5a-b7329b4e6471 tempest-ProjectReaderTests-473592646 None] Lock "cinder-c4517233-3436-4e0f-bfa2-410b22c28cd0-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-4c2c7af0-213a-41b4-baeb-78e531b95585-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "cinder-4c2c7af0-213a-41b4-baeb-78e531b95585-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" acquired by "delete_volume" :: waited 0.013s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9ca970-ed63-48ef-a405-c806729c5890]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:54 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 Aug 17 16:35:54 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:55 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585" returned: 0 in 0.448s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:55 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585 Aug 17 16:35:55 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (80e860cf-310b-4d87-948a-ddf320dff64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc06c98-de14-415e-9a99-3aa4b5945cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc06c98-de14-415e-9a99-3aa4b5945cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958365958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:55Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b71058-b5e2-43df-b497-125244a630ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:55 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b71058-b5e2-43df-b497-125244a630ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6f56c7-df53-48e8-ad31-8d7c2a4bb16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f6f56c7-df53-48e8-ad31-8d7c2a4bb16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd', 'volume_name': 'volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ffd75c-ea5b-4049-8edd-4179f4f5069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ffd75c-ea5b-4049-8edd-4179f4f5069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8d6ff6-7890-479a-9ff0-8c26a7373be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:55 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd', 'volume_size': 1} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958365958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:55Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:55 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4c2c7af0-213a-41b4-baeb-78e531b95585" returned: 0 in 0.413s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:55 devstack sudo[114412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd 1073741824 Aug 17 16:35:55 devstack sudo[114412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4c2c7af0-213a-41b4-baeb-78e531b95585" released by "delete_volume" :: held 0.948s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Created reservations ['e959ffa3-cb72-4f0e-93b1-b0a44c12f4d8', '2230dc24-51dc-410f-b4b0-31868fa6de8f', '64341fa0-8d8b-4566-b96a-00d9e36a0537', '18c6b5c5-8518-49a8-91de-952ab8cd5d10'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:55 devstack sudo[114414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:35:55 devstack sudo[114414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (91198b1e-7eb9-4e4c-a12d-36e4258f6d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f121bbb7-38f1-490a-a32e-21049563a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f121bbb7-38f1-490a-a32e-21049563a9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451742258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27abbe-f624-4051-9c2d-f9fca20a60cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:56Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:56 devstack sudo[114414]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d43fc9-d8ee-4e8b-8440-4fdf3bd8c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d43fc9-d8ee-4e8b-8440-4fdf3bd8c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6368808c-3b25-413f-97f3-695ad72ca25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6368808c-3b25-413f-97f3-695ad72ca25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb27abbe-f624-4051-9c2d-f9fca20a60cb', 'volume_name': 'volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:56 devstack sudo[114412]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f006d8-f986-4640-9353-c33ed10da006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47f006d8-f986-4640-9353-c33ed10da006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f18c4fc-fac4-4a3a-9ec2-b83776c620fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:56 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume fb27abbe-f624-4051-9c2d-f9fca20a60cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb', 'volume_size': 1} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd 1073741824" returned: 0 in 0.665s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.435s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:35:56 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Deleted volume successfully. Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ce49b018-d69a-4eae-b42d-e6b419aa1d68 tempest-ProjectReaderTests-473592646 None] Lock "cinder-4c2c7af0-213a-41b4-baeb-78e531b95585-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:56 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd Aug 17 16:35:56 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:56 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" returned: 0 in 0.566s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.634s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451742258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb27abbe-f624-4051-9c2d-f9fca20a60cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:56Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume fb27abbe-f624-4051-9c2d-f9fca20a60cb {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:56 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8d6ff6-7890-479a-9ff0-8c26a7373be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb 1073741824 Aug 17 16:35:57 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7403c-d901-4122-94fa-8feeeb08714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd (b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd): created successfully Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a7403c-d901-4122-94fa-8feeeb08714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (80e860cf-310b-4d87-948a-ddf320dff64f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-17561ba6-b5aa-493a-9281-9f32271988e1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (38c09014-89e3-422a-8afe-a4f714207543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8048b366-8200-4a82-90fa-b1a780c46b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8048b366-8200-4a82-90fa-b1a780c46b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541710747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:57Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdc8c7-e356-4eca-8a0b-2186c75f856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cdc8c7-e356-4eca-8a0b-2186c75f856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b62024-7e34-4433-9541-3b9abbe7d61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6b62024-7e34-4433-9541-3b9abbe7d61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f', 'volume_name': 'volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d770ff0-0c4c-4aaf-b629-eeabcd416b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d770ff0-0c4c-4aaf-b629-eeabcd416b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a509a9ae-c318-4e94-89b3-6a941469faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume 1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f', 'volume_size': 1} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Flow 'volume_create_manager' (080c8200-f5ff-4e5d-8b49-1e020cb4d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d356b371-2da0-42e7-82a5-39c4a06e9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb 1073741824" returned: 0 in 0.845s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d356b371-2da0-42e7-82a5-39c4a06e9244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb172ae-de49-40af-a8dd-4be4fc89a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1b4a23c4af4c7293477695c1d3ab53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='d26242e56d44490a8a83a5699bac99fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d30ea8-2e6c-4d45-b283-d492252cf04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d30ea8-2e6c-4d45-b283-d492252cf04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627c4133-6446-4b8b-ab34-b168b9cc52ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.image.glance [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Creating Keystone auth plugin from conf {{(pid=94468) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (87b36076-1a9f-4844-9168-96a1dccf6258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9355809-def0-4921-920b-43bc9c1d24bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (67f30964-6941-493e-9f0a-48bc75a67b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ac03d-31a8-48a7-b73f-49cdefb6ddf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9355809-def0-4921-920b-43bc9c1d24bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430733529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e96b70c-6d74-4168-a8d8-261ebfd249d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c98a6c1-72e8-4d46-a9f4-1fbc8405e97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c98a6c1-72e8-4d46-a9f4-1fbc8405e97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a65641-fda6-4495-ba5f-d810d8723535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:57 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a65641-fda6-4495-ba5f-d810d8723535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e96b70c-6d74-4168-a8d8-261ebfd249d5', 'volume_name': 'volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b9c37-89f7-45ee-824d-6741facb1d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b9c37-89f7-45ee-824d-6741facb1d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee4d533-de10-455c-8c8f-ac64d4bfb9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Volume 5e96b70c-6d74-4168-a8d8-261ebfd249d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5', 'volume_size': 1} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ac03d-31a8-48a7-b73f-49cdefb6ddf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291141462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e5dd7-9b18-4216-a9f3-13294c8e02b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9d7e34-e86f-44b1-b137-c9d4e7837ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9d7e34-e86f-44b1-b137-c9d4e7837ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fe6c37-fc44-4a21-82d0-d225b05efa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fe6c37-fc44-4a21-82d0-d225b05efa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1e5dd7-9b18-4216-a9f3-13294c8e02b2', 'volume_name': 'volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f8d94d-930c-47e1-a138-f947776aee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f8d94d-930c-47e1-a138-f947776aee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217e048d-d35d-4b63-9b3c-6afbd6c5275f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume 3f1e5dd7-9b18-4216-a9f3-13294c8e02b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2', 'volume_size': 1} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:58 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb Aug 17 16:35:58 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (53bdee29-5381-4efe-85d1-e6f8a1445620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47769345-f5ef-410e-b470-14eabe4b9d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47769345-f5ef-410e-b470-14eabe4b9d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1425164097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89543ac-aa70-410c-93e5-3607bc29ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6420109c-82f6-455f-a0ec-470a6ac8f4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6420109c-82f6-455f-a0ec-470a6ac8f4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535f509f-b701-4ff8-acf0-192667d2047c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535f509f-b701-4ff8-acf0-192667d2047c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89543ac-aa70-410c-93e5-3607bc29ebfb', 'volume_name': 'volume-c89543ac-aa70-410c-93e5-3607bc29ebfb', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b218f22-6e2d-43d9-ae5d-29345fce9a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b218f22-6e2d-43d9-ae5d-29345fce9a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9a885c-bff4-4c0f-9e37-3dbb2c247aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume c89543ac-aa70-410c-93e5-3607bc29ebfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89543ac-aa70-410c-93e5-3607bc29ebfb', 'volume_size': 1} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:58 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb" returned: 0 in 0.303s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-541710747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:57Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume 1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (627c4133-6446-4b8b-ab34-b168b9cc52ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'abb172ae-de49-40af-a8dd-4be4fc89a776', 'volume_name': 'volume-abb172ae-de49-40af-a8dd-4be4fc89a776', 'volume_size': 1, 'image_id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '170001f77d2e57aa5614bebf59e8d12f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce1b4a23c4af4c7293477695c1d3ab53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acb04af3eb3f3bd3e9edca27087546bb535af4b79d6fc13aeb0e230246b2e7fe1d6de9e1ff3b9b4d952d583088dd8580c607a7cc607169f77eda291e89fc9dc6', 'id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a9da749-0ee8-4edf-bbe3-61439231046b/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123bdf8-9b69-4ab9-8dd1-ee54a1dad1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2123bdf8-9b69-4ab9-8dd1-ee54a1dad1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f 1073741824 Aug 17 16:35:58 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df13369-3d65-4db5-b7df-255ea9f22d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Volume abb172ae-de49-40af-a8dd-4be4fc89a776: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-abb172ae-de49-40af-a8dd-4be4fc89a776', 'volume_size': 1, 'image_id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '170001f77d2e57aa5614bebf59e8d12f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce1b4a23c4af4c7293477695c1d3ab53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acb04af3eb3f3bd3e9edca27087546bb535af4b79d6fc13aeb0e230246b2e7fe1d6de9e1ff3b9b4d952d583088dd8580c607a7cc607169f77eda291e89fc9dc6', 'id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a9da749-0ee8-4edf-bbe3-61439231046b/file', 'properties': {}}, 'image_service': } Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Trying to clone abb172ae-de49-40af-a8dd-4be4fc89a776 from image 3a9da749-0ee8-4edf-bbe3-61439231046b at location (None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}]). {{(pid=94468) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f18c4fc-fac4-4a3a-9ec2-b83776c620fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e82b6d-3a33-4ba9-b2a2-b4e7ec674d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb (fb27abbe-f624-4051-9c2d-f9fca20a60cb): created successfully Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e82b6d-3a33-4ba9-b2a2-b4e7ec674d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (91198b1e-7eb9-4e4c-a12d-36e4258f6d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c59af5b0-69d1-4b2d-b577-b45323cd7e3b tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 17 16:35:58 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Image download 0.00 MB at 0.00 MB/s Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[294644b8-b5f2-426d-856c-bb2298a87920]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:58 devstack sudo[114442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:35:58 devstack sudo[114442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:58 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f 1073741824" returned: 0 in 0.553s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:59 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f Aug 17 16:35:59 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:59 devstack sudo[114442]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:59 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:35:59 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:59 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.265s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1430733529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e96b70c-6d74-4168-a8d8-261ebfd249d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Creating volume 5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:35:59 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a509a9ae-c318-4e94-89b3-6a941469faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:59 devstack sudo[114455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 1073741824 Aug 17 16:35:59 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a702dfcf-4756-49da-9362-c955916228b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:35:59 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f (1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f): created successfully Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a702dfcf-4756-49da-9362-c955916228b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (38c09014-89e3-422a-8afe-a4f714207543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:35:59 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-55814b62-0dd4-4c38-a15e-2aa6f21287b0 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:35:59 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 1 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Temporary image 3a9da749-0ee8-4edf-bbe3-61439231046b is fetched for user d26242e56d44490a8a83a5699bac99fb. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05718de-f819-4993-82e7-eb1e7d20f583]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:59 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:35:59 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:59 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 1073741824" returned: 0 in 0.577s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:35:59 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 Aug 17 16:35:59 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:35:59 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:35:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:00 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:36:00 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:00 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5" returned: 0 in 0.299s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-291141462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1e5dd7-9b18-4216-a9f3-13294c8e02b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume 3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:00 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:00 devstack sudo[114473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 1073741824 Aug 17 16:36:00 devstack sudo[114473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee4d533-de10-455c-8c8f-ac64d4bfb9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c8ec86-4c11-4147-9568-8f9cdb435de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:00 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Volume volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 (5e96b70c-6d74-4168-a8d8-261ebfd249d5): created successfully Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c8ec86-4c11-4147-9568-8f9cdb435de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (87b36076-1a9f-4844-9168-96a1dccf6258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:00 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7a0ec303-b012-4b26-89c7-ee7f9edb8c8e tempest-ProjectReaderTests-473592646 None] Created volume successfully. Aug 17 16:36:00 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:00 devstack sudo[114473]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 1073741824" returned: 0 in 0.542s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:00 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 Aug 17 16:36:00 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:01 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" returned: 0 in 0.297s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.924s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1425164097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89543ac-aa70-410c-93e5-3607bc29ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b0b0761575c4394969f283ee141a16b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='c79890f874fe491c93a35c062f35f99a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Creating volume c89543ac-aa70-410c-93e5-3607bc29ebfb {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:01 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217e048d-d35d-4b63-9b3c-6afbd6c5275f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d545cc3e-0507-4862-8b4b-184a8cd67ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:01 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb 1073741824 Aug 17 16:36:01 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:01 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 (3f1e5dd7-9b18-4216-a9f3-13294c8e02b2): created successfully Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d545cc3e-0507-4862-8b4b-184a8cd67ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (67f30964-6941-493e-9f0a-48bc75a67b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:01 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a35df7bb-f53b-4548-88bf-916038c480b9 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:36:01 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb 1073741824" returned: 0 in 0.532s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:01 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb Aug 17 16:36:01 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:02 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb" returned: 0 in 0.294s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.636s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb172ae-de49-40af-a8dd-4be4fc89a776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1b4a23c4af4c7293477695c1d3ab53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:35:58Z,use_quota=True,user_id='d26242e56d44490a8a83a5699bac99fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Creating volume abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:02 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c9a885c-bff4-4c0f-9e37-3dbb2c247aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89543ac-aa70-410c-93e5-3607bc29ebfb', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:02 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1073741824 Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271fd520-71e0-4862-9838-f6305870dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:02 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:02 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Volume volume-c89543ac-aa70-410c-93e5-3607bc29ebfb (c89543ac-aa70-410c-93e5-3607bc29ebfb): created successfully Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (271fd520-71e0-4862-9838-f6305870dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Flow 'volume_create_manager' (53bdee29-5381-4efe-85d1-e6f8a1445620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:02 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-fd1e0c1d-ded8-4331-b7d1-378b99f5d2f1 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created volume successfully. Aug 17 16:36:02 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1073741824" returned: 0 in 0.502s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-c89543ac-aa70-410c-93e5-3607bc29ebfb-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:02 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 Aug 17 16:36:02 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-c89543ac-aa70-410c-93e5-3607bc29ebfb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-c89543ac-aa70-410c-93e5-3607bc29ebfb" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-c89543ac-aa70-410c-93e5-3607bc29ebfb" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bda7ddc-ddb9-4579-b776-ca41127f4a42]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:02 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb Aug 17 16:36:02 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:02 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776" returned: 0 in 0.325s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.971s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Creating offline snapshot 7d418332-a1de-4e33-8224-92a1296788d8 of volume 5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7154845-7fe9-4a87-bd2f-9894073ee47a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Attempting download of 3a9da749-0ee8-4edf-bbe3-61439231046b ((None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}])) to volume abb172ae-de49-40af-a8dd-4be4fc89a776. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 17 16:36:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[40673f79-b4df-4e21-9824-f3965bb0adda]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack sudo[114504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 Aug 17 16:36:03 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5 Aug 17 16:36:03 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb Aug 17 16:36:03 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5" returned: 0 in 0.452s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 1G Aug 17 16:36:03 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c89543ac-aa70-410c-93e5-3607bc29ebfb" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-c89543ac-aa70-410c-93e5-3607bc29ebfb" released by "delete_volume" :: held 0.774s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:03 devstack sudo[114518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5 Aug 17 16:36:03 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['fc8a4fe9-359f-46ea-a02a-c87cb7e76e43', '8234e67c-e788-4fa5-8214-554cd1bffeb3', 'a8d0eefb-4f96-4421-a255-b7ba8f743574', 'e5a12579-229d-4d11-abd3-b50051625682'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:03 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:03 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5" returned: 1 in 0.517s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3a9da749-0ee8-4edf-bbe3-61439231046b_qfuu8cn5' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e3bdd2-7333-43d2-8f14-d1b4992bd37f]: (4, 'raw') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:03 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:04 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 1G" returned: 0 in 0.679s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:36:04 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" acquired by "delete_volume" :: waited 0.039s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:04 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.475s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:04 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e5fc4-6fac-4a65-870c-735438cc2e8c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-c8a53d21-51bb-46d8-bfd5-953d81cb47e7 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-c89543ac-aa70-410c-93e5-3607bc29ebfb-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:04 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 Aug 17 16:36:04 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 is being set with open permissions: ugo+rw Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 Aug 17 16:36:04 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD Aug 17 16:36:04 devstack sudo[114545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" returned: 0 in 0.469s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2 Aug 17 16:36:04 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8" returned: 0 in 0.306s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info Aug 17 16:36:04 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114545]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] 3a9da749-0ee8-4edf-bbe3-61439231046b was raw, converting to qcow2 {{(pid=94468) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:04 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 Aug 17 16:36:04 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:04 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" returned: 0 in 0.286s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:04 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2" released by "delete_volume" :: held 0.811s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['d6c16701-7ca6-424f-90b5-b1e428d63602', 'a2685bc9-2b01-45b9-bedb-b534f82e3654', '3e5e35d9-f15f-4e12-9b16-d1c02e35ed25', '776031b8-8ce6-4348-91b3-e61231a95948'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:05 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:05 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:05 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info" returned: 0 in 0.344s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info is being set with open permissions: ugo+rw Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:05 devstack sudo[114569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info Aug 17 16:36:05 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c1c3fe-a3f8-4882-aa6b-9e157837e649]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:05 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:05 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776" returned: 0 in 0.571s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3a9da749-0ee8-4edf-bbe3-61439231046b_w6rojfbsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:36:05 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Converted 0.00 MB image at 0.00 MB/s Aug 17 16:36:05 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a68fc5c2-542e-48ae-95ca-4800623f9f1a tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-3f1e5dd7-9b18-4216-a9f3-13294c8e02b2-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:05 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1G Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.info" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:05 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-73de43be-4d33-4806-a018-93dae4921db1 tempest-ProjectReaderTests-473592646 None] Create snapshot completed successfully Aug 17 16:36:05 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" returned: 0 in 0.437s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:05 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f Aug 17 16:36:05 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:05 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 1G" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Downloaded image 3a9da749-0ee8-4edf-bbe3-61439231046b ((None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}])) to volume abb172ae-de49-40af-a8dd-4be4fc89a776 successfully. {{(pid=94468) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Temporary image 3a9da749-0ee8-4edf-bbe3-61439231046b for user d26242e56d44490a8a83a5699bac99fb is deleted. {{(pid=94468) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.volume_utils [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Marking volume abb172ae-de49-40af-a8dd-4be4fc89a776 as bootable. {{(pid=94468) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Copying metadata from image 3a9da749-0ee8-4edf-bbe3-61439231046b to abb172ae-de49-40af-a8dd-4be4fc89a776. {{(pid=94468) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 17 16:36:05 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Creating volume glance metadata for volume abb172ae-de49-40af-a8dd-4be4fc89a776 backed by image 3a9da749-0ee8-4edf-bbe3-61439231046b with: {'image_id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '170001f77d2e57aa5614bebf59e8d12f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94468) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df13369-3d65-4db5-b7df-255ea9f22d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb172ae-de49-40af-a8dd-4be4fc89a776', 'volume_size': 1, 'image_id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3a9da749-0ee8-4edf-bbe3-61439231046b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '170001f77d2e57aa5614bebf59e8d12f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ce1b4a23c4af4c7293477695c1d3ab53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'acb04af3eb3f3bd3e9edca27087546bb535af4b79d6fc13aeb0e230246b2e7fe1d6de9e1ff3b9b4d952d583088dd8580c607a7cc607169f77eda291e89fc9dc6', 'id': '3a9da749-0ee8-4edf-bbe3-61439231046b', 'created_at': datetime.datetime(2026, 8, 17, 14, 35, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 17, 14, 35, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3a9da749-0ee8-4edf-bbe3-61439231046b/file', 'properties': {}}, 'image_service': }' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfec8ee-5129-47e3-ba3d-756150bc3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:06 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Volume volume-abb172ae-de49-40af-a8dd-4be4fc89a776 (abb172ae-de49-40af-a8dd-4be4fc89a776): created successfully Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdfec8ee-5129-47e3-ba3d-756150bc3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Flow 'volume_create_manager' (080c8200-f5ff-4e5d-8b49-1e020cb4d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f7e66139-4cc4-4bb2-a174-9ca9e4b4c7b7 tempest-VolumeImageDependencyTests-847386857 None] Created volume successfully. Aug 17 16:36:06 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" returned: 0 in 0.323s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f" released by "delete_volume" :: held 0.808s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-7d418332-a1de-4e33-8224-92a1296788d8-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['b3c2701d-7f52-4e24-9e73-70d01ce13a78', '646a4bf7-fcf3-4a17-87b2-8a40ccc00d19', 'ce7f80f7-cc9b-4100-875a-110e45f5c56a', '51344c05-23a9-44d9-9484-da7fec0c36aa'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-7d418332-a1de-4e33-8224-92a1296788d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-7d418332-a1de-4e33-8224-92a1296788d8" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-7d418332-a1de-4e33-8224-92a1296788d8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Deleting offline snapshot 7d418332-a1de-4e33-8224-92a1296788d8 of volume 5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] snapshot_file for this snap is: volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0eb18-7472-451a-8f90-fcbd1399b196]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:06 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:06 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-fb27abbe-f624-4051-9c2d-f9fca20a60cb-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:06 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 Aug 17 16:36:06 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-fb27abbe-f624-4051-9c2d-f9fca20a60cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-fb27abbe-f624-4051-9c2d-f9fca20a60cb" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-fb27abbe-f624-4051-9c2d-f9fca20a60cb" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eda029-3153-4d81-aebe-2c2df37cf4f2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:06 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:06 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-81631426-bca5-4e5c-8bde-179fbb840acb tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-1deb87d0-c4a7-48f4-aada-5d6ce7f87f6f-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:06 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb Aug 17 16:36:06 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:06 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8" returned: 0 in 0.496s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57aa836-2e68-47d2-812e-f902cd48bea0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:06 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 Aug 17 16:36:06 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:07 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb" returned: 0 in 0.476s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:07 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb Aug 17 16:36:07 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:07 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5" returned: 0 in 0.481s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Acquiring lock "cinder-abb172ae-de49-40af-a8dd-4be4fc89a776-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:07 devstack sudo[114609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "cinder-abb172ae-de49-40af-a8dd-4be4fc89a776-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:07 devstack sudo[114609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Acquiring lock "cinder-quobyte-abb172ae-de49-40af-a8dd-4be4fc89a776" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "cinder-quobyte-abb172ae-de49-40af-a8dd-4be4fc89a776" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:07 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fb27abbe-f624-4051-9c2d-f9fca20a60cb" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7c6c9a-4c11-4511-bf78-5ec2025f4d2d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-fb27abbe-f624-4051-9c2d-f9fca20a60cb" released by "delete_volume" :: held 0.946s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:07 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 Aug 17 16:36:07 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['f8f4ff36-e963-4953-b882-0f3c9309857e', '7bdcb13f-0120-4b8a-88e3-5cce72fb21f1', '3b042f7b-6b7b-4372-9ba9-340f4b8fc9c3', '685aeaae-5500-41fd-923d-790c0bc3a25c'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:07 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:07 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:07 devstack sudo[114609]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8" returned: 0 in 0.544s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:07 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8 Aug 17 16:36:07 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:08 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776" returned: 0 in 0.520s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:08 devstack sudo[114625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776 Aug 17 16:36:08 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:08 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d53d177a-5d71-4be8-b22c-2ebeab2122dd tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-fb27abbe-f624-4051-9c2d-f9fca20a60cb-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5.7d418332-a1de-4e33-8224-92a1296788d8" returned: 0 in 0.343s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-7d418332-a1de-4e33-8224-92a1296788d8" released by "_delete_snapshot" :: held 1.988s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" released by "delete_snapshot" :: held 2.016s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-abb172ae-de49-40af-a8dd-4be4fc89a776" returned: 0 in 0.307s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Created reservations ['6dfc5bab-6e2f-4c70-8b92-f7c8b7164f23', '1279a423-c0f8-4e30-b899-211a1377f2cf', '0797a900-0217-497b-b23e-6f5c78a5e5f9', '67e730c1-3d80-4b64-84f7-43305046ddd2'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "cinder-quobyte-abb172ae-de49-40af-a8dd-4be4fc89a776" released by "delete_volume" :: held 0.889s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Created reservations ['9d5b91a3-75ea-45f3-b55e-85fc50632b02', '52b465da-8009-4628-b904-739bd010e677', '95189cbe-6a6d-4f21-9817-6fda28582544', '75497b27-ad3a-4ddc-aed2-e94ee114a0e1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Delete snapshot completed successfully. Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b469b55a-66c0-438b-a02f-0e96c21faf7e tempest-ProjectReaderTests-473592646 None] Lock "cinder-7d418332-a1de-4e33-8224-92a1296788d8-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:08 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:08 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:08 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.306s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:08 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Deleted volume successfully. Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e3c53950-14c8-4589-a42b-db55fa5c98dc tempest-VolumeImageDependencyTests-847386857 None] Lock "cinder-abb172ae-de49-40af-a8dd-4be4fc89a776-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00c2b7a-df0b-4f6a-b7eb-f45bd674ee92]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:09 devstack sudo[114633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd Aug 17 16:36:09 devstack sudo[114633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-5e96b70c-6d74-4168-a8d8-261ebfd249d5-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:09 devstack sudo[114633]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" returned: 0 in 0.444s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "cinder-5e96b70c-6d74-4168-a8d8-261ebfd249d5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:09 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd Aug 17 16:36:09 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[63335356-14ee-413a-86f2-e69faa03230f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:09 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 Aug 17 16:36:09 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:09 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd" released by "delete_volume" :: held 0.878s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['015a2ac4-81de-4a04-8262-1ceab409e4c1', '69e25f8f-bedd-4237-9cba-a14c807c445f', '15cd8550-037b-4dcd-baea-4b1731632eaa', '1fe39ef2-78cc-4040-8e7a-6127e9596150'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:10 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:10 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-339b79b9-b59d-4d97-996d-1509fd6c9e40-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-339b79b9-b59d-4d97-996d-1509fd6c9e40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-339b79b9-b59d-4d97-996d-1509fd6c9e40" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:10 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5" returned: 0 in 0.656s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-339b79b9-b59d-4d97-996d-1509fd6c9e40" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleting offline snapshot 339b79b9-b59d-4d97-996d-1509fd6c9e40 of volume 315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:10 devstack sudo[114649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5 Aug 17 16:36:10 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] snapshot_file for this snap is: volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef803590-f99b-4b74-902e-5204a2b1de11]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:10 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:10 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 Aug 17 16:36:10 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5e11acea-e5cc-46de-b878-f45740d5ede8 tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-b3a6329a-1a12-4ebf-98c7-9f52d60ce4fd-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:10 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-5e96b70c-6d74-4168-a8d8-261ebfd249d5" returned: 0 in 0.460s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-5e96b70c-6d74-4168-a8d8-261ebfd249d5" released by "delete_volume" :: held 1.213s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Created reservations ['a82ddd96-f622-4f66-97a3-0f3665ccc237', 'b70dacfe-f370-4805-b164-c2dd2498700e', 'bc1fec3e-2c17-4d54-98ff-69d736e074cc', '8e3a58c4-1a14-489d-bbfa-15af4e339098'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:10 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40" returned: 0 in 0.553s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-315e7f7d-09e3-4088-8049-5252f0fb31da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:10 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:10 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea84c6c-a200-48a2-b457-443013dc894f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:11 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da Aug 17 16:36:11 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:11 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.341s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:11 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Deleted volume successfully. Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a36a0ab2-6c04-4c88-9a47-6cb878b016ea tempest-ProjectReaderTests-473592646 None] Lock "cinder-5e96b70c-6d74-4168-a8d8-261ebfd249d5-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:11 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da" returned: 0 in 0.502s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:11 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 Aug 17 16:36:11 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:11 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40" returned: 0 in 0.492s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:12 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40 Aug 17 16:36:12 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:12 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da.339b79b9-b59d-4d97-996d-1509fd6c9e40" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-339b79b9-b59d-4d97-996d-1509fd6c9e40" released by "_delete_snapshot" :: held 2.132s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" released by "delete_snapshot" :: held 2.183s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (f55cbc2f-1c65-4fa5-bd1c-beae92be6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7508b27-ebae-478d-8489-354bf4685031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7508b27-ebae-478d-8489-354bf4685031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999110451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb509df-cf2a-4857-866a-c017c01f37e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:12Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f863a86d-c0c6-4550-9db8-25f9929b4e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f863a86d-c0c6-4550-9db8-25f9929b4e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38f9d3b-401b-4270-a476-093aff2b7f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38f9d3b-401b-4270-a476-093aff2b7f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eb509df-cf2a-4857-866a-c017c01f37e1', 'volume_name': 'volume-9eb509df-cf2a-4857-866a-c017c01f37e1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce21847-7b46-4b69-86e0-3289eb9a19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce21847-7b46-4b69-86e0-3289eb9a19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08649bfb-25e8-46ff-a5c2-691c15288ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:12 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Volume 9eb509df-cf2a-4857-866a-c017c01f37e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eb509df-cf2a-4857-866a-c017c01f37e1', 'volume_size': 1} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-999110451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eb509df-cf2a-4857-866a-c017c01f37e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:12Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Creating volume 9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:12 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:12 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 1073741824 Aug 17 16:36:12 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['fe6063f4-eba6-447e-86d0-d981e5aa1c43', '128e133a-1d28-418c-a8ec-6ec2308b84bd', '80181837-4d4c-44fc-880b-361c713dbb4c', '626db9ea-fe07-436a-9851-2721e1de6503'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:12 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Delete snapshot completed successfully. Aug 17 16:36:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-872b7cf7-2bb4-43d9-8a23-286a19eddc5f tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-339b79b9-b59d-4d97-996d-1509fd6c9e40-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:13 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 1073741824" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:13 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 Aug 17 16:36:13 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:13 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1" returned: 0 in 0.313s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08649bfb-25e8-46ff-a5c2-691c15288ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eb509df-cf2a-4857-866a-c017c01f37e1', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2916f6e-a9e7-4bd5-8307-303b7650d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-315e7f7d-09e3-4088-8049-5252f0fb31da-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:13 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Volume volume-9eb509df-cf2a-4857-866a-c017c01f37e1 (9eb509df-cf2a-4857-866a-c017c01f37e1): created successfully Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2916f6e-a9e7-4bd5-8307-303b7650d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (f55cbc2f-1c65-4fa5-bd1c-beae92be6c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-315e7f7d-09e3-4088-8049-5252f0fb31da-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e91e0e76-2d7c-49a9-ac3f-6d04fb63a6c7 tempest-ProjectReaderTests-473592646 None] Created volume successfully. Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb581c-3bca-4f08-bedb-b8a4bff8889a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:13 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da Aug 17 16:36:13 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:14 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da" returned: 0 in 0.453s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:14 devstack sudo[114690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da Aug 17 16:36:14 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:14 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-315e7f7d-09e3-4088-8049-5252f0fb31da" returned: 0 in 0.329s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-quobyte-315e7f7d-09e3-4088-8049-5252f0fb31da" released by "delete_volume" :: held 0.885s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Created reservations ['832cad72-d959-4bea-9754-09d72fc2c890', '96e6a40f-a960-4d97-b556-0732492d8d88', 'bb7a33b4-ee5d-4ffd-960d-01c2ee2f06be', '82457980-7dd8-4079-931a-3bc239f074de'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Creating offline snapshot 7cc5c116-3173-49a2-9812-75bf0a8338cd of volume 9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:14 devstack sudo[114693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:14 devstack sudo[114693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9cba1-c2ce-4b7a-8315-4bad2ad485da]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:15 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 Aug 17 16:36:15 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:15 devstack sudo[114693]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:15 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Deleted volume successfully. Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d337bca4-f29a-4004-91d2-b311ed09ad6e tempest-CreateVolumesFromSnapshotTest-868343313 None] Lock "cinder-315e7f7d-09e3-4088-8049-5252f0fb31da-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:15 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1" returned: 0 in 0.514s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:15 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd 1G Aug 17 16:36:15 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:15 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd 1G" returned: 0 in 0.586s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb509df-cf2a-4857-866a-c017c01f37e1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:15 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb509df-cf2a-4857-866a-c017c01f37e1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd Aug 17 16:36:15 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:16 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9eb509df-cf2a-4857-866a-c017c01f37e1 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd" returned: 0 in 0.436s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:16 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd is being set with open permissions: ugo+rw Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:16 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd Aug 17 16:36:16 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:16 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd" returned: 0 in 0.345s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=198,cinder:UPDATE=307,cinder:INSERT=73,cinder:DELETE=23 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=221,cinder:UPDATE=269,cinder:INSERT=82,cinder:DELETE=28 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:36:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:16 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info Aug 17 16:36:16 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:17 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info" returned: 0 in 0.399s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:17 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info is being set with open permissions: ugo+rw Aug 17 16:36:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:17 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info Aug 17 16:36:17 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:17 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.info" returned: 0 in 0.259s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4c90902e-d659-4a82-ba70-eb56591aa465 tempest-ProjectReaderTests-473592646 None] Create snapshot completed successfully Aug 17 16:36:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-7cc5c116-3173-49a2-9812-75bf0a8338cd-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-7cc5c116-3173-49a2-9812-75bf0a8338cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-7cc5c116-3173-49a2-9812-75bf0a8338cd" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-7cc5c116-3173-49a2-9812-75bf0a8338cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Deleting offline snapshot 7cc5c116-3173-49a2-9812-75bf0a8338cd of volume 9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] snapshot_file for this snap is: volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a80867d-02e2-4211-a83e-837c13bdd6d0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:18 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd Aug 17 16:36:18 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:18 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd" returned: 0 in 0.538s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9eb509df-cf2a-4857-866a-c017c01f37e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9743ad-8a64-43f1-b934-affe9ebbe577]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:18 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 Aug 17 16:36:18 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (b2cad67b-d0eb-4692-84f4-0e6cbf4b5607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d469677-ffee-452a-bd13-9898674c0c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d469677-ffee-452a-bd13-9898674c0c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128293761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1ddbce-b3f1-40d0-b237-9ce92ce74637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:19Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbca271-a74d-4a31-97f4-1834c5353cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecbca271-a74d-4a31-97f4-1834c5353cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bba5f1-4aee-4821-a687-d02a863d2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8bba5f1-4aee-4821-a687-d02a863d2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a1ddbce-b3f1-40d0-b237-9ce92ce74637', 'volume_name': 'volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a158fad-3f60-4d6d-b143-a05ff796cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a158fad-3f60-4d6d-b143-a05ff796cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01615664-9378-42fd-84d1-7a63cccc9f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Volume 1a1ddbce-b3f1-40d0-b237-9ce92ce74637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637', 'volume_size': 1} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128293761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a1ddbce-b3f1-40d0-b237-9ce92ce74637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:19Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Creating volume 1a1ddbce-b3f1-40d0-b237-9ce92ce74637 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:19 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:19 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1" returned: 0 in 0.660s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:19 devstack sudo[114734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 1073741824 Aug 17 16:36:19 devstack sudo[114734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:19 devstack sudo[114735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd Aug 17 16:36:19 devstack sudo[114735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Flow 'volume_create_manager' (e4d2b3cf-39b0-4ccb-9ab9-f48ba980f424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925efab7-1436-42c3-bc42-ff9ed1e6da84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack sudo[114735]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925efab7-1436-42c3-bc42-ff9ed1e6da84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39be77e7-3983-49ed-b4b6-98ce1d19c309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e80373ad5a4db8ba9056c03e5ad407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:20Z,use_quota=True,user_id='add9397d21434aeba8b6727737295eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed747a9-3a5c-4b5d-ad69-283b03359ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed747a9-3a5c-4b5d-ad69-283b03359ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da15c5c6-3ae3-4549-a0c0-d197d876629f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da15c5c6-3ae3-4549-a0c0-d197d876629f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39be77e7-3983-49ed-b4b6-98ce1d19c309', 'volume_name': 'volume-39be77e7-3983-49ed-b4b6-98ce1d19c309', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c072ae-e6e3-4b95-abbf-ac058d610d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c072ae-e6e3-4b95-abbf-ac058d610d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d8b87-f17c-48c5-a04c-5f57d60f5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:19 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Volume 39be77e7-3983-49ed-b4b6-98ce1d19c309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39be77e7-3983-49ed-b4b6-98ce1d19c309', 'volume_size': 1} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:19 devstack sudo[114734]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd" returned: 0 in 0.526s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 1073741824" returned: 0 in 0.550s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:19 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd Aug 17 16:36:19 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:19 devstack sudo[114748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 Aug 17 16:36:19 devstack sudo[114748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:20 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1.7cc5c116-3173-49a2-9812-75bf0a8338cd" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:20 devstack sudo[114748]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" returned: 0 in 0.275s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-7cc5c116-3173-49a2-9812-75bf0a8338cd" released by "_delete_snapshot" :: held 2.164s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.344s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39be77e7-3983-49ed-b4b6-98ce1d19c309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e80373ad5a4db8ba9056c03e5ad407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:20Z,use_quota=True,user_id='add9397d21434aeba8b6727737295eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Creating volume 39be77e7-3983-49ed-b4b6-98ce1d19c309 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:20 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01615664-9378-42fd-84d1-7a63cccc9f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 1073741824 Aug 17 16:36:20 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095513a5-216f-4675-9561-6591e197e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" released by "delete_snapshot" :: held 2.246s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Volume volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 (1a1ddbce-b3f1-40d0-b237-9ce92ce74637): created successfully Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095513a5-216f-4675-9561-6591e197e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (b2cad67b-d0eb-4692-84f4-0e6cbf4b5607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6544bd11-bf26-4197-9f83-5bd2014f73d7 tempest-ProjectReaderTests-1571085118 None] Created volume successfully. Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Created reservations ['4da0747e-2ee3-490e-8e7f-3667f5687924', '08234802-c321-4bd8-b558-12b334892c52', 'f64481a5-e602-4b06-9d54-710947cb2e53', '3eaba3ff-6cf7-44ee-b012-ef93974ad442'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:20 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Delete snapshot completed successfully. Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-23fb7403-76bb-4b81-a932-777f3c300fb7 tempest-ProjectReaderTests-473592646 None] Lock "cinder-7cc5c116-3173-49a2-9812-75bf0a8338cd-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (17730738-d40b-4edc-bf41-c854763aff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503ea7a7-e3b6-4d4c-895d-c0bf5068fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503ea7a7-e3b6-4d4c-895d-c0bf5068fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165767094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfd61ea-d9e7-4580-a114-1759f4a97a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:21Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e03a5c7-6988-41b7-94b5-85e71fcd11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e03a5c7-6988-41b7-94b5-85e71fcd11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f36079-24df-4efb-b863-394a389507d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f36079-24df-4efb-b863-394a389507d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfd61ea-d9e7-4580-a114-1759f4a97a73', 'volume_name': 'volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07bf567-dc4f-479d-84c4-fe2aae1e4faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07bf567-dc4f-479d-84c4-fe2aae1e4faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cdcbb7-a4c2-4716-8698-9c827845cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Volume ebfd61ea-d9e7-4580-a114-1759f4a97a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73', 'volume_size': 1} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:20 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 1073741824" returned: 0 in 0.486s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:20 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 Aug 17 16:36:20 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:20 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309" returned: 0 in 0.242s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165767094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfd61ea-d9e7-4580-a114-1759f4a97a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:21Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Creating volume ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d8b87-f17c-48c5-a04c-5f57d60f5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39be77e7-3983-49ed-b4b6-98ce1d19c309', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c0e54-b1d0-4cab-b3fb-71747901efda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:21 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 1073741824 Aug 17 16:36:21 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Volume volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 (39be77e7-3983-49ed-b4b6-98ce1d19c309): created successfully Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6c0e54-b1d0-4cab-b3fb-71747901efda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Flow 'volume_create_manager' (e4d2b3cf-39b0-4ccb-9ab9-f48ba980f424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b74911dc-0e92-43ff-b8c6-fe7279a71f55 tempest-CinderUnicodeTest-303446280 None] Created volume successfully. Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-9eb509df-cf2a-4857-866a-c017c01f37e1-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "cinder-9eb509df-cf2a-4857-866a-c017c01f37e1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a313818-2afc-4201-80f0-37bdbe0a4aeb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:21 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 Aug 17 16:36:21 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:21 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 1073741824" returned: 0 in 0.484s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:21 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 Aug 17 16:36:21 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-1a1ddbce-b3f1-40d0-b237-9ce92ce74637-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "cinder-1a1ddbce-b3f1-40d0-b237-9ce92ce74637-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-quobyte-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bb4657-df42-4db7-b6b6-3a4b7ebd1b77]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:21 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1" returned: 0 in 0.449s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:21 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1 Aug 17 16:36:21 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:21 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73" returned: 0 in 0.314s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:21 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 Aug 17 16:36:21 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17cdcbb7-a4c2-4716-8698-9c827845cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92375da-cbfb-460b-947c-2980d22f9398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Volume volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 (ebfd61ea-d9e7-4580-a114-1759f4a97a73): created successfully Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92375da-cbfb-460b-947c-2980d22f9398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (17730738-d40b-4edc-bf41-c854763aff85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0f20e138-13e2-4b09-8fe7-efc5518e0079 tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:36:22 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-9eb509df-cf2a-4857-866a-c017c01f37e1" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-9eb509df-cf2a-4857-866a-c017c01f37e1" released by "delete_volume" :: held 0.801s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Created reservations ['21d102ae-b18f-4500-b16b-a3e3a1401287', '3faf19bb-9556-48dd-9dc5-e78c6f85cc9c', '1b53e5e5-1213-4029-8098-10151a4513fd', '706c26b0-1482-4ff5-827e-7ad7246d0b1e'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:22 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" returned: 0 in 0.496s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:22 devstack sudo[114783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637 Aug 17 16:36:22 devstack sudo[114783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:22 devstack sudo[114785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:22 devstack sudo[114785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Flow 'volume_create_manager' (14f6ee67-90d3-4036-bc86-26f354f09ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426d0a1a-cc21-427b-87e2-e826d14f9e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426d0a1a-cc21-427b-87e2-e826d14f9e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1118361869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34911fda-0a30-49b9-91aa-09d51df780c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e80373ad5a4db8ba9056c03e5ad407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:22Z,use_quota=True,user_id='add9397d21434aeba8b6727737295eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfb42ca-77bf-41c9-8509-1786dc2a8959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfb42ca-77bf-41c9-8509-1786dc2a8959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b948f23-1945-4d1b-8f0d-66603e7b4a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b948f23-1945-4d1b-8f0d-66603e7b4a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34911fda-0a30-49b9-91aa-09d51df780c9', 'volume_name': 'volume-34911fda-0a30-49b9-91aa-09d51df780c9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ec88a0-8531-4103-9244-56f67bf94a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ec88a0-8531-4103-9244-56f67bf94a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298e86e-887c-4e69-9187-1d0cdfec2bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Volume 34911fda-0a30-49b9-91aa-09d51df780c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34911fda-0a30-49b9-91aa-09d51df780c9', 'volume_size': 1} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1118361869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34911fda-0a30-49b9-91aa-09d51df780c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e80373ad5a4db8ba9056c03e5ad407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:22Z,use_quota=True,user_id='add9397d21434aeba8b6727737295eba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Creating volume 34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:22 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:22 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 1073741824 Aug 17 16:36:22 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:22 devstack sudo[114783]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-1a1ddbce-b3f1-40d0-b237-9ce92ce74637" released by "delete_volume" :: held 0.873s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:22 devstack sudo[114785]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.331s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Created reservations ['b783989e-0da5-4d53-8d2e-24e33c5f77c6', '8dac460f-bf3c-4488-8b42-355ea1f21679', '7c97b545-e3f0-463a-ba89-0dd8d2a88399', '8176ea11-3f25-4ee6-ab34-dc2f2239a69a'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Deleted volume successfully. Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-03b12c25-ff0d-47d5-a64c-1c28de7cbf3f tempest-ProjectReaderTests-473592646 None] Lock "cinder-9eb509df-cf2a-4857-866a-c017c01f37e1-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:22 devstack sudo[114792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:22 devstack sudo[114792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:23 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 1073741824" returned: 0 in 0.602s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:23 devstack sudo[114792]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.364s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Deleted volume successfully. Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (3c9bc0b1-4cb5-4233-a1aa-75c012babb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116b749-f4de-424e-8403-bbe81832c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-1453e227-05d9-47ce-8136-00cf3e29ecbe tempest-ProjectReaderTests-1571085118 None] Lock "cinder-1a1ddbce-b3f1-40d0-b237-9ce92ce74637-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:23 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 Aug 17 16:36:23 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9116b749-f4de-424e-8403-bbe81832c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372119960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6fcb9-1025-466a-911f-f0be856f7e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:23Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e23944-a155-4122-aab9-c547a810ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e23944-a155-4122-aab9-c547a810ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f346abbf-8033-4146-85c5-62d0a120cfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f346abbf-8033-4146-85c5-62d0a120cfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9b6fcb9-1025-466a-911f-f0be856f7e2b', 'volume_name': 'volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6627db77-ee6b-4872-a82b-ac2f2303c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6627db77-ee6b-4872-a82b-ac2f2303c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fff22f3-9e54-4540-9344-e7eb9e1c8988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Volume e9b6fcb9-1025-466a-911f-f0be856f7e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b', 'volume_size': 1} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (693b2d6e-f1c4-4a0b-b788-6f12538405d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:23 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8ffd3f-2de7-4a66-80f9-4b2293400a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9" returned: 0 in 0.324s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372119960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9b6fcb9-1025-466a-911f-f0be856f7e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:23Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Creating volume e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8ffd3f-2de7-4a66-80f9-4b2293400a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867400075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93248b7-a3f9-4f0a-87bc-d81249d8a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:23Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b 1073741824 Aug 17 16:36:23 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630e410b-ed27-43e0-b3ff-d4251f00b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (630e410b-ed27-43e0-b3ff-d4251f00b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1098bf66-0518-43d4-86c4-440a895c6f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1098bf66-0518-43d4-86c4-440a895c6f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93248b7-a3f9-4f0a-87bc-d81249d8a3c5', 'volume_name': 'volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3557d3-c30d-4b81-9891-1d92709b3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3557d3-c30d-4b81-9891-1d92709b3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0484d0-9212-49e1-9e53-12860f1b07fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Volume c93248b7-a3f9-4f0a-87bc-d81249d8a3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5', 'volume_size': 1} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298e86e-887c-4e69-9187-1d0cdfec2bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34911fda-0a30-49b9-91aa-09d51df780c9', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cd290c-773b-4de7-8fe9-99ade6ba9f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Volume volume-34911fda-0a30-49b9-91aa-09d51df780c9 (34911fda-0a30-49b9-91aa-09d51df780c9): created successfully Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cd290c-773b-4de7-8fe9-99ade6ba9f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:23 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Flow 'volume_create_manager' (14f6ee67-90d3-4036-bc86-26f354f09ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:23 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-accdb62e-d658-463e-94aa-2937b33fa473 tempest-CinderUnicodeTest-303446280 None] Created volume successfully. Aug 17 16:36:24 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b 1073741824" returned: 0 in 0.434s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:24 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b Aug 17 16:36:24 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:24 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b" returned: 0 in 0.246s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.963s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fff22f3-9e54-4540-9344-e7eb9e1c8988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb83f9e-156b-4594-a1ed-8bf0c43f4719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot c2bbc6dc-155d-46dc-a32f-31132ea74bcb of volume ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:24 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Volume volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b (e9b6fcb9-1025-466a-911f-f0be856f7e2b): created successfully Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb83f9e-156b-4594-a1ed-8bf0c43f4719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (3c9bc0b1-4cb5-4233-a1aa-75c012babb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a98fd4-23fd-47c5-81ae-3dd1b7d25269]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-dd113e6e-6c38-4881-98a8-2d29dbea36d0 tempest-ProjectReaderTests-473592646 None] Created volume successfully. Aug 17 16:36:24 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 Aug 17 16:36:24 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:24 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:24 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb 1G Aug 17 16:36:24 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:25 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb 1G" returned: 0 in 0.428s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:25 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb Aug 17 16:36:25 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:25 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:25 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb is being set with open permissions: ugo+rw Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:25 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb Aug 17 16:36:25 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:25 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb" returned: 0 in 0.255s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:25 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info Aug 17 16:36:25 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:26 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info" returned: 0 in 0.260s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:26 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info is being set with open permissions: ugo+rw Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:26 devstack sudo[114832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info Aug 17 16:36:26 devstack sudo[114832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:26 devstack sudo[114832]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.info" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.709s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867400075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93248b7-a3f9-4f0a-87bc-d81249d8a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:23Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Creating volume c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:26 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:26 devstack sudo[114836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 1073741824 Aug 17 16:36:26 devstack sudo[114836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-98eb678c-03e1-48de-9f81-97cda4dc6d9e tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:36:26 devstack sudo[114836]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 1073741824" returned: 0 in 0.444s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:26 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 Aug 17 16:36:26 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:27 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" returned: 0 in 0.265s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.324s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0484d0-9212-49e1-9e53-12860f1b07fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39534baa-500b-43e8-acde-8dc52dc6f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Creating offline snapshot 19a526b0-7e27-4e21-b35d-d021e269a856 of volume 34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:27 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Volume volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 (c93248b7-a3f9-4f0a-87bc-d81249d8a3c5): created successfully Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39534baa-500b-43e8-acde-8dc52dc6f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (693b2d6e-f1c4-4a0b-b788-6f12538405d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b2c2b-f686-4ab6-b498-8907ff984a0e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:27 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4154cb51-4df4-4b5c-870a-1ac061de7726 tempest-ProjectReaderTests-1571085118 None] Created volume successfully. Aug 17 16:36:27 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 Aug 17 16:36:27 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-c2bbc6dc-155d-46dc-a32f-31132ea74bcb-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-c2bbc6dc-155d-46dc-a32f-31132ea74bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-c2bbc6dc-155d-46dc-a32f-31132ea74bcb" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-c2bbc6dc-155d-46dc-a32f-31132ea74bcb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot c2bbc6dc-155d-46dc-a32f-31132ea74bcb of volume ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ccfeea-577a-4b0b-90cf-717a8c893f91]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:27 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9" returned: 0 in 0.395s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:27 devstack sudo[114850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 1G Aug 17 16:36:27 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:27 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb Aug 17 16:36:27 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-quobyte-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb070a93-fef8-4dad-934b-2e979df8a065]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:27 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb" returned: 0 in 0.447s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a35ca-88b0-46ed-8448-ff54a6fee11c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 1G" returned: 0 in 0.504s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34911fda-0a30-49b9-91aa-09d51df780c9 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 Aug 17 16:36:28 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34911fda-0a30-49b9-91aa-09d51df780c9 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 Aug 17 16:36:28 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 Aug 17 16:36:28 devstack sudo[114860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" returned: 0 in 0.410s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34911fda-0a30-49b9-91aa-09d51df780c9 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856" returned: 0 in 0.315s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 is being set with open permissions: ugo+rw Aug 17 16:36:28 devstack sudo[114876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5 Aug 17 16:36:28 devstack sudo[114876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114860]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 Aug 17 16:36:28 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb Aug 17 16:36:28 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114876]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" returned: 0 in 0.285s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5" released by "delete_volume" :: held 0.743s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:28 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856" returned: 0 in 0.282s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Created reservations ['085ed43d-97d5-42f9-81a6-ef288fcafcac', 'a6c91579-d391-4c1f-a4e1-7d521bde973d', '49cd7957-79b6-4034-9f24-61f05942fae3', '130c2985-6edc-4e70-8322-d552a4aeba23'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:28 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb" returned: 0 in 0.399s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb Aug 17 16:36:28 devstack sudo[114890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:28 devstack sudo[114892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:28 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:29 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:29 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info is being set with open permissions: ugo+rw Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:29 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info Aug 17 16:36:29 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:29 devstack sudo[114890]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73.c2bbc6dc-155d-46dc-a32f-31132ea74bcb" returned: 0 in 0.309s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:29 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.291s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-c2bbc6dc-155d-46dc-a32f-31132ea74bcb" released by "_delete_snapshot" :: held 1.685s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Deleted volume successfully. Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" released by "delete_snapshot" :: held 1.720s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4ec71abe-7230-4784-a711-dccc107ae2b6 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-c93248b7-a3f9-4f0a-87bc-d81249d8a3c5-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Created reservations ['7a335101-49ce-41cb-a54e-357085f7394f', 'e8811c92-fc61-4ccd-85eb-111bd8598e9a', '6e9c889c-2b0a-48eb-a80a-024fd80020fd', '4d1c8f6e-37f3-460e-8688-106e6ac4ac00'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e2606452-0039-4dac-9e20-7ebfd8543773 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-c2bbc6dc-155d-46dc-a32f-31132ea74bcb-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:29 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.info" returned: 0 in 0.323s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.271s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.061s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Creating offline snapshot 96cda4aa-a4e2-4ce1-ad6b-91424b930fce of volume e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f9cbf-75f2-42fc-965a-d178fa8fff4c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:29 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7f8e0472-fce5-4327-ad87-7cdc6fa310a1 tempest-CinderUnicodeTest-303446280 None] Create snapshot completed successfully Aug 17 16:36:29 devstack sudo[114900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b Aug 17 16:36:29 devstack sudo[114900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-ebfd61ea-d9e7-4580-a114-1759f4a97a73-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (3afa4bbb-a069-4a2e-adcb-7ae24cadce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6791582-b986-4efa-8277-a793cf969ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-ebfd61ea-d9e7-4580-a114-1759f4a97a73-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6791582-b986-4efa-8277-a793cf969ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877340288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775616a-5975-43c7-88d2-59560503b07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:30Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc37b582-5f3d-4e95-b14c-37cb5fb836cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc37b582-5f3d-4e95-b14c-37cb5fb836cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779788ae-1e7c-4df7-a988-c2baa9696d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (779788ae-1e7c-4df7-a988-c2baa9696d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f775616a-5975-43c7-88d2-59560503b07b', 'volume_name': 'volume-f775616a-5975-43c7-88d2-59560503b07b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea2d02e-3cc1-4377-a8cd-1964ed6ed375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea2d02e-3cc1-4377-a8cd-1964ed6ed375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d20c4c-0560-469a-865d-84a9b972e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:29 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Volume f775616a-5975-43c7-88d2-59560503b07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f775616a-5975-43c7-88d2-59560503b07b', 'volume_size': 1} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aaf6f2-5f48-49e7-b392-d37d877aad1f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:29 devstack sudo[114900]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b" returned: 0 in 0.417s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:29 devstack sudo[114906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce 1G Aug 17 16:36:29 devstack sudo[114906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:29 devstack sudo[114905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 Aug 17 16:36:29 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-19a526b0-7e27-4e21-b35d-d021e269a856-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-19a526b0-7e27-4e21-b35d-d021e269a856-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-quobyte-19a526b0-7e27-4e21-b35d-d021e269a856" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-19a526b0-7e27-4e21-b35d-d021e269a856" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Deleting offline snapshot 19a526b0-7e27-4e21-b35d-d021e269a856 of volume 34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] snapshot_file for this snap is: volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:30 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc03f85-86b7-4833-a3dd-8f3c780592eb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73" returned: 0 in 0.391s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73 Aug 17 16:36:30 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 Aug 17 16:36:30 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack sudo[114906]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce 1G" returned: 0 in 0.485s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack sudo[114920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce Aug 17 16:36:30 devstack sudo[114920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ebfd61ea-d9e7-4580-a114-1759f4a97a73" returned: 0 in 0.290s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ebfd61ea-d9e7-4580-a114-1759f4a97a73" released by "delete_volume" :: held 0.749s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Created reservations ['2a1a82e2-a9d0-4499-8540-de96a666a09b', 'c0f4e3c1-127b-425c-8a58-f774ab2f6159', 'b79746bb-a40a-47ed-8a35-299090712c57', 'c5497a4b-1b45-4676-9d92-f4a1e28be233'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:30 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34911fda-0a30-49b9-91aa-09d51df780c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[187edc4c-4a3e-4c3a-9b1d-85d7b059c1bf]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack sudo[114920]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce" returned: 0 in 0.343s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:30 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce is being set with open permissions: ugo+rw Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:30 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce Aug 17 16:36:30 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack sudo[114937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:30 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 Aug 17 16:36:30 devstack sudo[114937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:30 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce" returned: 0 in 0.351s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:31 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack sudo[114937]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.366s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9" returned: 0 in 0.474s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:31 devstack sudo[114946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info Aug 17 16:36:31 devstack sudo[114946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:36:31 devstack sudo[114948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 Aug 17 16:36:31 devstack sudo[114948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-38ae4515-6c14-4f53-ad6b-92de48e49f2b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-ebfd61ea-d9e7-4580-a114-1759f4a97a73-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:31 devstack sudo[114946]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info is being set with open permissions: ugo+rw Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:31 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info Aug 17 16:36:31 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (8df0fdef-f830-4cf2-9597-e33492651e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803c4ef-39bf-43f2-8408-3b8068e16020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2803c4ef-39bf-43f2-8408-3b8068e16020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693226380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047f20fc-2e4c-4f80-967a-0115a8ac1122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:31Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b330ab5-465f-4226-af9f-f5f196d52af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b330ab5-465f-4226-af9f-f5f196d52af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f88bc63-627b-4d2d-8f99-2bb03f280f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f88bc63-627b-4d2d-8f99-2bb03f280f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '047f20fc-2e4c-4f80-967a-0115a8ac1122', 'volume_name': 'volume-047f20fc-2e4c-4f80-967a-0115a8ac1122', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae51d79c-1684-4d73-8929-09e6d86c4411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae51d79c-1684-4d73-8929-09e6d86c4411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c72b80-f0b1-4b69-ae45-0936ae265af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:31 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Volume 047f20fc-2e4c-4f80-967a-0115a8ac1122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-047f20fc-2e4c-4f80-967a-0115a8ac1122', 'volume_size': 1} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:31 devstack sudo[114948]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856" returned: 0 in 0.442s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:31 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856 Aug 17 16:36:31 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.info" returned: 0 in 0.282s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.935s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877340288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775616a-5975-43c7-88d2-59560503b07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:30Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Creating volume f775616a-5975-43c7-88d2-59560503b07b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:31 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:31 devstack sudo[114959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b 1073741824 Aug 17 16:36:31 devstack sudo[114959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-42c80b5a-e14a-4f11-91a0-a7e16eae39e9 tempest-ProjectReaderTests-473592646 None] Create snapshot completed successfully Aug 17 16:36:31 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9.19a526b0-7e27-4e21-b35d-d021e269a856" returned: 0 in 0.273s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-19a526b0-7e27-4e21-b35d-d021e269a856" released by "_delete_snapshot" :: held 1.706s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" released by "delete_snapshot" :: held 1.736s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:31 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Created reservations ['a98f5e48-ea99-4afe-bf95-15a24a2a47da', '8b186045-9939-415e-8911-0eae5c73f3db', '85bb964f-368d-423b-9912-c27797e0bcbf', '853c9627-03df-4770-af97-7a75de5c08d3'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:31 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Delete snapshot completed successfully. Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-90409545-fa2a-4bc4-b3ec-bfbdbf7228d1 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-19a526b0-7e27-4e21-b35d-d021e269a856-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:32 devstack sudo[114959]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b 1073741824" returned: 0 in 0.470s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:32 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b Aug 17 16:36:32 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-34911fda-0a30-49b9-91aa-09d51df780c9-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-34911fda-0a30-49b9-91aa-09d51df780c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" acquired by "delete_volume" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a89ef2-e542-4be5-8b71-aa4af2a6382a]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:32 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693226380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047f20fc-2e4c-4f80-967a-0115a8ac1122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:31Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Creating volume 047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:32 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:32 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 1073741824 Aug 17 16:36:32 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d20c4c-0560-469a-865d-84a9b972e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f775616a-5975-43c7-88d2-59560503b07b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56cb7ab-f49c-42d2-9283-64a9960cf86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:32 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 Aug 17 16:36:32 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Volume volume-f775616a-5975-43c7-88d2-59560503b07b (f775616a-5975-43c7-88d2-59560503b07b): created successfully Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56cb7ab-f49c-42d2-9283-64a9960cf86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (3afa4bbb-a069-4a2e-adcb-7ae24cadce76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-64c1d19e-f7e3-415c-989c-853d1d22508f tempest-ProjectReaderTests-1571085118 None] Created volume successfully. Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-96cda4aa-a4e2-4ce1-ad6b-91424b930fce-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-96cda4aa-a4e2-4ce1-ad6b-91424b930fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-96cda4aa-a4e2-4ce1-ad6b-91424b930fce" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-96cda4aa-a4e2-4ce1-ad6b-91424b930fce" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Deleting offline snapshot 96cda4aa-a4e2-4ce1-ad6b-91424b930fce of volume e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] snapshot_file for this snap is: volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8a202-857e-4876-ac78-b42f45d85d91]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:32 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9" returned: 0 in 0.509s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:32 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9 Aug 17 16:36:32 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-f775616a-5975-43c7-88d2-59560503b07b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-f775616a-5975-43c7-88d2-59560503b07b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:33 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce Aug 17 16:36:33 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-quobyte-f775616a-5975-43c7-88d2-59560503b07b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-f775616a-5975-43c7-88d2-59560503b07b" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:33 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 1073741824" returned: 0 in 0.666s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9e76dc-2d71-494c-8d91-597095e4cbdc]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 Aug 17 16:36:33 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-34911fda-0a30-49b9-91aa-09d51df780c9" returned: 0 in 0.326s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-34911fda-0a30-49b9-91aa-09d51df780c9" released by "delete_volume" :: held 0.899s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:33 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b Aug 17 16:36:33 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Created reservations ['46780337-81db-48c9-b2f8-462a576710e4', '392167ef-a58b-4c6d-b80f-9c62ee992398', 'ae92415b-770a-4288-b5b7-c034ab97239f', 'bae03d10-a0ce-4329-9436-ecc78441f918'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:33 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce" returned: 0 in 0.535s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2daf3-1cdb-4f37-bc2a-520a995f8b20]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-39be77e7-3983-49ed-b4b6-98ce1d19c309-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:33 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack sudo[114996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:33 devstack sudo[114996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "cinder-39be77e7-3983-49ed-b4b6-98ce1d19c309-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c72b80-f0b1-4b69-ae45-0936ae265af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047f20fc-2e4c-4f80-967a-0115a8ac1122', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e6a626-cbde-4a50-864c-84eb4fbe9441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Volume volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 (047f20fc-2e4c-4f80-967a-0115a8ac1122): created successfully Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e6a626-cbde-4a50-864c-84eb4fbe9441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (8df0fdef-f830-4cf2-9597-e33492651e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3198b090-553d-4eb5-a30c-b55bd1c42ca9 tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Acquiring lock "cinder-quobyte-39be77e7-3983-49ed-b4b6-98ce1d19c309" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:33 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b Aug 17 16:36:33 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-39be77e7-3983-49ed-b4b6-98ce1d19c309" acquired by "delete_volume" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:33 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b" returned: 0 in 0.580s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afbd6cd-2ed9-4bc8-a288-5eb44766930c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:33 devstack sudo[115000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b Aug 17 16:36:33 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 Aug 17 16:36:33 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:33 devstack sudo[114996]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:33 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Deleted volume successfully. Aug 17 16:36:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-97fbcbc0-6a31-4c3f-90fb-85e13e37c022 tempest-CinderUnicodeTest-303446280 None] Lock "cinder-34911fda-0a30-49b9-91aa-09d51df780c9-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:34 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b" returned: 0 in 0.568s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:34 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce Aug 17 16:36:34 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:34 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-f775616a-5975-43c7-88d2-59560503b07b" returned: 0 in 0.346s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-f775616a-5975-43c7-88d2-59560503b07b" released by "delete_volume" :: held 0.989s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Created reservations ['d2e13877-9835-42fd-ad82-4094b45b0ac4', 'ce339867-851b-488e-9f12-aa738f53c414', '1b8b1a89-c97b-401a-8f93-fd09d41eb3e7', 'eaf21382-0c3a-4aa1-8c4b-2a592b9868bc'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:34 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309" returned: 0 in 0.470s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:34 devstack sudo[115015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309 Aug 17 16:36:34 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:34 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:34 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:34 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce" returned: 0 in 0.491s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:34 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-39be77e7-3983-49ed-b4b6-98ce1d19c309" returned: 0 in 0.330s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:34 devstack sudo[115059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce Aug 17 16:36:34 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Deleted volume successfully. Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "cinder-quobyte-39be77e7-3983-49ed-b4b6-98ce1d19c309" released by "delete_volume" :: held 0.880s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02bcf616-3250-49c1-a84a-0257e10d4031 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-f775616a-5975-43c7-88d2-59560503b07b-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Created reservations ['6d1f5af5-8187-4571-9bad-d401a7a9722f', '67ef2680-7407-49b5-922a-16f358b036ef', 'a59265ff-0779-4ace-a7e4-5087ea64468d', '14aeba8d-1be7-4a8d-beae-277efb0730e5'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:34 devstack sudo[115063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:34 devstack sudo[115063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:34 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b.96cda4aa-a4e2-4ce1-ad6b-91424b930fce" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot 0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 of volume 047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-96cda4aa-a4e2-4ce1-ad6b-91424b930fce" released by "_delete_snapshot" :: held 2.204s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" released by "delete_snapshot" :: held 2.234s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[24af515a-151c-4f5d-b632-35c3d8816e33]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Created reservations ['c384a1a9-77b0-4328-926f-c278e0a300a2', '0d4241ef-4864-4c9c-b2d2-ead8bfe447b2', 'e9b0a983-1018-4c81-8bea-65661d88d8e7', '9e6164bc-daa4-432a-b48a-5a1b306bf634'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:35 devstack sudo[115063]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.356s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Deleted volume successfully. Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-27d88004-106b-46e5-9ef2-1457631e7bdd tempest-CinderUnicodeTest-303446280 None] Lock "cinder-39be77e7-3983-49ed-b4b6-98ce1d19c309-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:35 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Delete snapshot completed successfully. Aug 17 16:36:35 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 Aug 17 16:36:35 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-29854444-7ed0-4dad-aa83-8702f5bee32a tempest-ProjectReaderTests-473592646 None] Lock "cinder-96cda4aa-a4e2-4ce1-ad6b-91424b930fce-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:35 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122" returned: 0 in 0.539s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:35 devstack sudo[115072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 1G Aug 17 16:36:35 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (ed859566-8658-46ea-87e8-097de28e199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e90c0-9804-4eb2-b5b2-555b56dc006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590e90c0-9804-4eb2-b5b2-555b56dc006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533387446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acef0850-71ae-4b61-bead-b6fe7a59eb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:36Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d1df95-7e48-4ded-a659-4083a085f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d1df95-7e48-4ded-a659-4083a085f952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bd6398-c3db-447b-a0bd-0feb06d50596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bd6398-c3db-447b-a0bd-0feb06d50596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acef0850-71ae-4b61-bead-b6fe7a59eb9a', 'volume_name': 'volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2ffb5-ca7f-40d8-bbe1-71d1f768ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d2ffb5-ca7f-40d8-bbe1-71d1f768ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559b389f-62ab-45a8-b7d1-a5f5c15be506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:35 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Volume acef0850-71ae-4b61-bead-b6fe7a59eb9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a', 'volume_size': 1} Aug 17 16:36:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-e9b6fcb9-1025-466a-911f-f0be856f7e2b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "cinder-e9b6fcb9-1025-466a-911f-f0be856f7e2b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" acquired by "delete_volume" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1478c9fa-5d04-424d-87b3-a4d86e317c4c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:36 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 1G" returned: 0 in 0.654s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:36 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 Aug 17 16:36:36 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:36 devstack sudo[115080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b Aug 17 16:36:36 devstack sudo[115080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:36 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:36 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 is being set with open permissions: ugo+rw Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:36 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 Aug 17 16:36:36 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:36 devstack sudo[115080]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b" returned: 0 in 0.467s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:36 devstack sudo[115093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b Aug 17 16:36:36 devstack sudo[115093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:36 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" returned: 0 in 0.274s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:36 devstack sudo[115093]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-e9b6fcb9-1025-466a-911f-f0be856f7e2b" returned: 0 in 0.275s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:37 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info Aug 17 16:36:37 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-e9b6fcb9-1025-466a-911f-f0be856f7e2b" released by "delete_volume" :: held 0.823s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Created reservations ['d8075705-8b62-4f07-94cb-e3143433e870', 'ec6015ba-1d94-4c03-b9aa-9982fbe38c1c', '906d0c1f-a053-4b75-a221-bbe140ddb726', '0502ed1e-cab9-4ff3-b00f-167f780bb86b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:37 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:37 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:37 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info" returned: 0 in 0.285s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:37 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info is being set with open permissions: ugo+rw Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:37 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info Aug 17 16:36:37 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:37 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.290s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Deleted volume successfully. Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-4edb3ef1-3b48-48de-adca-ef0ea811107f tempest-ProjectReaderTests-473592646 None] Lock "cinder-e9b6fcb9-1025-466a-911f-f0be856f7e2b-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:37 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.info" returned: 0 in 0.308s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533387446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acef0850-71ae-4b61-bead-b6fe7a59eb9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd25cbfbe854631b5c29bed8f806189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:36Z,use_quota=True,user_id='3d2e5688d9da43398128bbaabbdc8256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Creating volume acef0850-71ae-4b61-bead-b6fe7a59eb9a {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:37 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-8e1050ad-9e07-486b-a839-e560600a9501 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:36:37 devstack sudo[115106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a 1073741824 Aug 17 16:36:37 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (856afec7-edaf-4a77-95cb-9635fba8b26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd953d1-d714-489c-9465-a3c22b6232d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd953d1-d714-489c-9465-a3c22b6232d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839099518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7e871-38fc-470f-bb47-e0af7eb9a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:38Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2559e-fd26-41e9-b5a9-a49ea19184b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e2559e-fd26-41e9-b5a9-a49ea19184b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916239d-246c-4901-87f1-bc173d3ffdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916239d-246c-4901-87f1-bc173d3ffdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba7e871-38fc-470f-bb47-e0af7eb9a577', 'volume_name': 'volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3bd408-a46e-4e0a-b814-864cf58f2991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3bd408-a46e-4e0a-b814-864cf58f2991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bbbadb-3510-4689-b187-201522dfc4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:37 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Volume 4ba7e871-38fc-470f-bb47-e0af7eb9a577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577', 'volume_size': 1} Aug 17 16:36:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot 0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 of volume 047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a87fa9a-9103-4625-aff5-1f91dbd7bfe8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:38 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a 1073741824" returned: 0 in 0.617s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:38 devstack sudo[115113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a Aug 17 16:36:38 devstack sudo[115113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:38 devstack sudo[115112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 Aug 17 16:36:38 devstack sudo[115112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:38 devstack sudo[115113]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1839099518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7e871-38fc-470f-bb47-e0af7eb9a577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711a609a37054d66a76c54f45e6c2744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:38Z,use_quota=True,user_id='2d92517a20724097b27b6443d215d5d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Creating volume 4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:38 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:38 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 1073741824 Aug 17 16:36:38 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559b389f-62ab-45a8-b7d1-a5f5c15be506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad19238-9f29-4d44-bcf8-b2fbaae81cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:38 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Volume volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a (acef0850-71ae-4b61-bead-b6fe7a59eb9a): created successfully Aug 17 16:36:38 devstack sudo[115112]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad19238-9f29-4d44-bcf8-b2fbaae81cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Flow 'volume_create_manager' (ed859566-8658-46ea-87e8-097de28e199c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" returned: 0 in 0.506s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-047f20fc-2e4c-4f80-967a-0115a8ac1122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[90add5c5-ccdb-4d0f-a8e5-69f2945e2a15]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:38 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e10ec745-05b6-45af-9428-e98e4e6db4a8 tempest-ProjectReaderTests-1571085118 None] Created volume successfully. Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:38 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-d7806ca6-2fbc-43b5-8731-17d2f66f0018 tempest-ProjectAdminTests-1660148305 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864204406738, 'free_capacity_gb': 1775.6864204406738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94468) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 17 16:36:38 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 Aug 17 16:36:38 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-acef0850-71ae-4b61-bead-b6fe7a59eb9a-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-acef0850-71ae-4b61-bead-b6fe7a59eb9a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "cinder-quobyte-acef0850-71ae-4b61-bead-b6fe7a59eb9a" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-acef0850-71ae-4b61-bead-b6fe7a59eb9a" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:39 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 1073741824" returned: 0 in 0.637s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[38add7f9-01bc-4d7d-a579-fc9f15b9e8cd]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:39 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122" returned: 0 in 0.498s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:39 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 Aug 17 16:36:39 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack sudo[115134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 Aug 17 16:36:39 devstack sudo[115134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a Aug 17 16:36:39 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack sudo[115134]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577" returned: 0 in 0.286s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94bbbadb-3510-4689-b187-201522dfc4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd46b33-2fda-42d2-9f23-6a349d766373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:39 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Volume volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 (4ba7e871-38fc-470f-bb47-e0af7eb9a577): created successfully Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd46b33-2fda-42d2-9f23-6a349d766373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Flow 'volume_create_manager' (856afec7-edaf-4a77-95cb-9635fba8b26b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-f040dafd-ae41-4092-b986-97e23efd3c9f tempest-ProjectReaderTests-473592646 None] Created volume successfully. Aug 17 16:36:39 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a" returned: 0 in 0.457s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:39 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" returned: 0 in 0.465s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:39 devstack sudo[115146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a Aug 17 16:36:39 devstack sudo[115146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack sudo[115147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1 Aug 17 16:36:39 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:39 devstack sudo[115146]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-acef0850-71ae-4b61-bead-b6fe7a59eb9a" returned: 0 in 0.292s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-quobyte-acef0850-71ae-4b61-bead-b6fe7a59eb9a" released by "delete_volume" :: held 0.819s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:40 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122.0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" returned: 0 in 0.332s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1" released by "_delete_snapshot" :: held 1.968s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" released by "delete_snapshot" :: held 2.005s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Created reservations ['e5592e82-9b9c-47da-929c-9e32e1d2ad13', 'ee5c4417-592d-41a0-98b7-d1d3f12991be', '87e8db7b-4462-4f75-a05f-5a9aef77f5c2', '17478b8f-792a-4bc4-bd74-1b53beda6f84'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Creating offline snapshot 50e0759f-171d-46d9-a39f-f93fa80f943f of volume 4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a741675a-db9a-4beb-ab97-046525b1511d]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:40 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:40 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Created reservations ['707fec34-5e9d-4bae-9710-91298c39fd68', 'cf77b5e7-e4c0-4cd5-aed5-d62c782a9afb', '5ec3dd9d-82c2-485e-9ac4-404b8ee5945f', '14de81ca-415f-4f82-a161-c19e43389095'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2f0b9936-e0c0-4736-9483-c507246387ac tempest-ProjectMemberTests-1637810001 None] Lock "cinder-0ac507bf-680a-4931-b4ac-47a6aaeb5ca1-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:40 devstack sudo[115153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 Aug 17 16:36:40 devstack sudo[115153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:40 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:40 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Deleted volume successfully. Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7bd1ee16-47e4-4462-8c26-c3a7394e5588 tempest-ProjectReaderTests-1571085118 None] Lock "cinder-acef0850-71ae-4b61-bead-b6fe7a59eb9a-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:40 devstack sudo[115153]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577" returned: 0 in 0.463s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:40 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f 1G Aug 17 16:36:40 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:41 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f 1G" returned: 0 in 0.436s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:41 devstack sudo[115165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f Aug 17 16:36:41 devstack sudo[115165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-047f20fc-2e4c-4f80-967a-0115a8ac1122-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-047f20fc-2e4c-4f80-967a-0115a8ac1122-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b9ca1-3960-4d2a-a070-83c5efcdc800]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:41 devstack sudo[115165]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f" returned: 0 in 0.466s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:41 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f is being set with open permissions: ugo+rw Aug 17 16:36:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:41 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 Aug 17 16:36:41 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:41 devstack sudo[115173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f Aug 17 16:36:41 devstack sudo[115173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:42 devstack sudo[115173]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f" returned: 0 in 0.331s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:42 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122" returned: 0 in 0.479s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:42 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122 Aug 17 16:36:42 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:42 devstack sudo[115181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info Aug 17 16:36:42 devstack sudo[115181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:42 devstack sudo[115181]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:42 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info" returned: 0 in 0.305s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:42 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info is being set with open permissions: ugo+rw Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-047f20fc-2e4c-4f80-967a-0115a8ac1122" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:42 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info Aug 17 16:36:42 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-047f20fc-2e4c-4f80-967a-0115a8ac1122" released by "delete_volume" :: held 0.921s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Created reservations ['baddbfca-797e-4b77-a351-6a36f1a546d1', '792f720b-9cc6-4eb0-8994-230bafaf8fa5', 'c0a34489-e09d-409e-bc05-dbaea7f9431c', '0493fcdb-bedc-4256-a546-6843bd18eb7b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:42 devstack sudo[115187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:42 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:42 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.info" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.543s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d66ace03-795b-4c82-bf52-783cf7ddbaea tempest-ProjectReaderTests-473592646 None] Create snapshot completed successfully Aug 17 16:36:43 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.301s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:43 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-9796da93-2f82-4a86-9f48-58160b6bf0dc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-047f20fc-2e4c-4f80-967a-0115a8ac1122-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-50e0759f-171d-46d9-a39f-f93fa80f943f-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-50e0759f-171d-46d9-a39f-f93fa80f943f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-50e0759f-171d-46d9-a39f-f93fa80f943f" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-50e0759f-171d-46d9-a39f-f93fa80f943f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Deleting offline snapshot 50e0759f-171d-46d9-a39f-f93fa80f943f of volume 4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] snapshot_file for this snap is: volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3d2e8e-29ba-42ed-a406-1410b142b905]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:43 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:43 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f Aug 17 16:36:43 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:44 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9a0e92-39b5-42a2-96a9-272e6c575296]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:44 devstack sudo[115197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 Aug 17 16:36:44 devstack sudo[115197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (81e23369-692a-48aa-a64a-76e4113a9871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14560c6-b9d8-41e1-b81a-dea1570af0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14560c6-b9d8-41e1-b81a-dea1570af0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727532394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7c8777-9979-46b5-ab62-5f67e5e657bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:44Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc82ce3-ae81-4275-87de-cddb5781e2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc82ce3-ae81-4275-87de-cddb5781e2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7844788-72f1-4b10-a92a-46f16fb68cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7844788-72f1-4b10-a92a-46f16fb68cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7c8777-9979-46b5-ab62-5f67e5e657bc', 'volume_name': 'volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6bf2cb-c85c-48a5-accb-c2d8eb3aef6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6bf2cb-c85c-48a5-accb-c2d8eb3aef6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bed35f-62e8-4514-af54-4d67b4fe715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:44 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Volume bf7c8777-9979-46b5-ab62-5f67e5e657bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc', 'volume_size': 1} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-727532394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7c8777-9979-46b5-ab62-5f67e5e657bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:44Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Creating volume bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:44 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:44 devstack sudo[115202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc 1073741824 Aug 17 16:36:44 devstack sudo[115202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:44 devstack sudo[115197]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577" returned: 0 in 0.389s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:44 devstack sudo[115204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f Aug 17 16:36:44 devstack sudo[115204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:44 devstack sudo[115204]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f" returned: 0 in 0.370s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:44 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f Aug 17 16:36:44 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:44 devstack sudo[115202]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc 1073741824" returned: 0 in 0.454s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:44 devstack sudo[115216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc Aug 17 16:36:44 devstack sudo[115216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:45 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577.50e0759f-171d-46d9-a39f-f93fa80f943f" returned: 0 in 0.285s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-50e0759f-171d-46d9-a39f-f93fa80f943f" released by "_delete_snapshot" :: held 1.606s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" released by "delete_snapshot" :: held 1.641s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:45 devstack sudo[115216]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc" returned: 0 in 0.281s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bed35f-62e8-4514-af54-4d67b4fe715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed0704-a3e5-4091-8343-e213252fb329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:45 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Volume volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc (bf7c8777-9979-46b5-ab62-5f67e5e657bc): created successfully Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18ed0704-a3e5-4091-8343-e213252fb329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (81e23369-692a-48aa-a64a-76e4113a9871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-6300c0dd-cd38-4fe2-ad19-f5bf856d38fc tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Created reservations ['ddba7de2-286f-45b4-9cf7-1530af8a80e9', 'f57ba3cf-5b6b-4fd9-a6e5-cdc4f10926e3', '4b0a7d56-c678-4d5c-9895-8e55e5494481', '5ab35575-d212-414f-9723-32ffbe92c719'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:45 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Delete snapshot completed successfully. Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-99352ec6-157d-4d3f-99cf-791010df2551 tempest-ProjectReaderTests-473592646 None] Lock "cinder-50e0759f-171d-46d9-a39f-f93fa80f943f-delete_snapshot" released by "delete_snapshot" :: held 1.860s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-4ba7e871-38fc-470f-bb47-e0af7eb9a577-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "cinder-4ba7e871-38fc-470f-bb47-e0af7eb9a577-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Acquiring lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" acquired by "delete_volume" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd8900-427b-4f4d-bca7-17268f01d050]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:45 devstack sudo[115220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 Aug 17 16:36:45 devstack sudo[115220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:46 devstack sudo[115220]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:46 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577 Aug 17 16:36:46 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:46 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-4ba7e871-38fc-470f-bb47-e0af7eb9a577" returned: 0 in 0.256s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "cinder-quobyte-4ba7e871-38fc-470f-bb47-e0af7eb9a577" released by "delete_volume" :: held 0.705s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Created reservations ['c5e5395e-e684-471b-93e2-6ffb623b7d00', '00f0a3f6-1fcf-4eb4-9c85-d37c71c9dd33', '8467b772-bac2-4c20-baf5-e7373c0ba8d6', '8bf81706-3b4f-4ef9-b10e-9e3c78910b91'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot 26c7a61d-0984-4075-a556-2974c17355ce of volume bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:46 devstack sudo[115228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:46 devstack sudo[115228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[45818c7f-96eb-45b2-a79b-ffadd0ade932]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:46 devstack sudo[115230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:46 devstack sudo[115230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:46 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:46 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:46 devstack sudo[115228]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.263s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Deleted volume successfully. Aug 17 16:36:46 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-350944b6-a044-4829-9481-6dbb2191bd2d tempest-ProjectReaderTests-473592646 None] Lock "cinder-4ba7e871-38fc-470f-bb47-e0af7eb9a577-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:47 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:47 devstack sudo[115230]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.327s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc" returned: 0 in 0.461s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:36:47 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce 1G Aug 17 16:36:47 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:47 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce 1G" returned: 0 in 0.535s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:47 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce Aug 17 16:36:47 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:48 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:48 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce is being set with open permissions: ugo+rw Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:48 devstack sudo[115250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce Aug 17 16:36:48 devstack sudo[115250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:48 devstack sudo[115250]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:48 devstack sudo[115253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info Aug 17 16:36:48 devstack sudo[115253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:48 devstack sudo[115253]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:48 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info is being set with open permissions: ugo+rw Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:48 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info Aug 17 16:36:48 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:48 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.info" returned: 0 in 0.299s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:48 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ab2e039e-fa2c-496e-9b2b-a183dba7bfb9 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-26c7a61d-0984-4075-a556-2974c17355ce-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-26c7a61d-0984-4075-a556-2974c17355ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-26c7a61d-0984-4075-a556-2974c17355ce" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-26c7a61d-0984-4075-a556-2974c17355ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot 26c7a61d-0984-4075-a556-2974c17355ce of volume bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6aa140-f6c5-4671-9dfa-f1326bda71db]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:50 devstack sudo[115259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce Aug 17 16:36:50 devstack sudo[115259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:50 devstack sudo[115259]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce" returned: 0 in 0.440s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd4f616-8804-4671-bb15-277643f7009b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:50 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc Aug 17 16:36:50 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:50 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc" returned: 0 in 0.414s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:50 devstack sudo[115269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce Aug 17 16:36:50 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:51 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce" returned: 0 in 0.391s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:51 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce Aug 17 16:36:51 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Flow 'volume_create_manager' (01cbbe9b-3c72-4573-9a10-d6effb3d083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fac6ad-1242-4eca-9ad0-1d217fbb43ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fac6ad-1242-4eca-9ad0-1d217fbb43ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976247280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7475128-b67f-45d8-ae2a-490c065514e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3bc9f53606477bbddda9776889de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:51Z,use_quota=True,user_id='e971014b21224bdea0393c214af7d377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f21e4-67b3-4620-9c11-67c385bf0226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f21e4-67b3-4620-9c11-67c385bf0226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb92ab-081f-4d16-a7ff-374fafc25490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcb92ab-081f-4d16-a7ff-374fafc25490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7475128-b67f-45d8-ae2a-490c065514e4', 'volume_name': 'volume-d7475128-b67f-45d8-ae2a-490c065514e4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed32b830-a5d0-4b6f-be8e-a4da2c4f748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed32b830-a5d0-4b6f-be8e-a4da2c4f748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c377ad8-a545-4b76-925e-d7d7811dae2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:51 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Volume d7475128-b67f-45d8-ae2a-490c065514e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7475128-b67f-45d8-ae2a-490c065514e4', 'volume_size': 1} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1976247280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7475128-b67f-45d8-ae2a-490c065514e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3bc9f53606477bbddda9776889de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:51Z,use_quota=True,user_id='e971014b21224bdea0393c214af7d377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Creating volume d7475128-b67f-45d8-ae2a-490c065514e4 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:51 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:51 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc.26c7a61d-0984-4075-a556-2974c17355ce" returned: 0 in 0.279s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:51 devstack sudo[115277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 1073741824 Aug 17 16:36:51 devstack sudo[115277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-26c7a61d-0984-4075-a556-2974c17355ce" released by "_delete_snapshot" :: held 1.651s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" released by "delete_snapshot" :: held 1.675s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Created reservations ['2fbe8a14-59e2-43a5-b966-c0587a182af6', 'bd6a7d29-94c9-4676-8e61-33929f1728e4', '625d0c13-a825-426e-907c-e7fcbd09549a', 'afee1de9-14f9-49ba-91ec-45358011b131'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:51 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-71323ec2-38f0-4ef6-8496-6aa8724872fc tempest-ProjectMemberTests-1637810001 None] Lock "cinder-26c7a61d-0984-4075-a556-2974c17355ce-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:51 devstack sudo[115277]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 1073741824" returned: 0 in 0.423s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:51 devstack sudo[115282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 Aug 17 16:36:51 devstack sudo[115282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:51 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-bf7c8777-9979-46b5-ab62-5f67e5e657bc-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "cinder-bf7c8777-9979-46b5-ab62-5f67e5e657bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa50d964-4106-41c3-8bc7-0a74120fed6b]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:52 devstack sudo[115282]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c377ad8-a545-4b76-925e-d7d7811dae2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7475128-b67f-45d8-ae2a-490c065514e4', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d808976-2610-4591-b9d3-a2d5d6ec2ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:52 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Volume volume-d7475128-b67f-45d8-ae2a-490c065514e4 (d7475128-b67f-45d8-ae2a-490c065514e4): created successfully Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d808976-2610-4591-b9d3-a2d5d6ec2ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Flow 'volume_create_manager' (01cbbe9b-3c72-4573-9a10-d6effb3d083a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:52 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc Aug 17 16:36:52 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:52 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b7585279-3b8b-4ebf-bb63-018d75696abd tempest-ProjectReaderTests-540622723 None] Created volume successfully. Aug 17 16:36:52 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:52 devstack sudo[115290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc Aug 17 16:36:52 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Acquiring lock "cinder-d7475128-b67f-45d8-ae2a-490c065514e4-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "cinder-d7475128-b67f-45d8-ae2a-490c065514e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Acquiring lock "cinder-quobyte-d7475128-b67f-45d8-ae2a-490c065514e4" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "cinder-quobyte-d7475128-b67f-45d8-ae2a-490c065514e4" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c377ea3-3f89-48b4-90e4-5f4e70dd1992]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:52 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-bf7c8777-9979-46b5-ab62-5f67e5e657bc" returned: 0 in 0.275s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf7c8777-9979-46b5-ab62-5f67e5e657bc" released by "delete_volume" :: held 0.708s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:52 devstack sudo[115292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 Aug 17 16:36:52 devstack sudo[115292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Created reservations ['e6c77558-8037-4921-bf13-c37b949c8079', '785317fd-ed89-421b-97cf-846656981dd5', '10f55d45-acdb-413d-92de-62a3329d0f19', '4230e5ee-1737-4203-959e-cc4d6e3590e0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:52 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:52 devstack sudo[115295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:52 devstack sudo[115295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:53 devstack sudo[115292]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4" returned: 0 in 0.388s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:53 devstack sudo[115301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4 Aug 17 16:36:53 devstack sudo[115301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:53 devstack sudo[115295]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.256s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-abaf19ce-c981-4353-95c5-4e0129c058db tempest-ProjectMemberTests-1637810001 None] Lock "cinder-bf7c8777-9979-46b5-ab62-5f67e5e657bc-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:53 devstack sudo[115301]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-d7475128-b67f-45d8-ae2a-490c065514e4" returned: 0 in 0.288s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "cinder-quobyte-d7475128-b67f-45d8-ae2a-490c065514e4" released by "delete_volume" :: held 0.729s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Created reservations ['8762a0ac-c755-4421-b5b5-d275c9d84e5b', '069d511f-ff14-4c85-a02a-b33ce0cf1e10', '981f2e54-d562-466e-93a8-b90b2fd3dc2b', '42b14e6a-7bda-4647-8899-51878f059216'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:53 devstack sudo[115305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:53 devstack sudo[115305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (360b3dc6-1af7-4c10-a843-e078803cec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2625e2a3-69fa-4725-804d-cbc4722a0ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2625e2a3-69fa-4725-804d-cbc4722a0ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486164644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a0bd41-2461-4bd7-b265-34ca9c06c9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:54Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c978b-bfdd-49ad-9bd2-cc6f1a07df59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8c978b-bfdd-49ad-9bd2-cc6f1a07df59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4703d237-f077-4d70-8d52-b8d7fcd8be01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4703d237-f077-4d70-8d52-b8d7fcd8be01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38a0bd41-2461-4bd7-b265-34ca9c06c9b8', 'volume_name': 'volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbccf948-9404-4dbe-a572-e47fcfa1d5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbccf948-9404-4dbe-a572-e47fcfa1d5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e619303-a9c8-4bc4-83dc-4e9872704953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:53 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Volume 38a0bd41-2461-4bd7-b265-34ca9c06c9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8', 'volume_size': 1} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486164644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38a0bd41-2461-4bd7-b265-34ca9c06c9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:54Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Creating volume 38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:53 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:53 devstack sudo[115305]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:53 devstack sudo[115309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 1073741824 Aug 17 16:36:53 devstack sudo[115309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:53 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Deleted volume successfully. Aug 17 16:36:53 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d46007f8-e1db-4b6d-9555-816cb3812d18 tempest-ProjectReaderTests-540622723 None] Lock "cinder-d7475128-b67f-45d8-ae2a-490c065514e4-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Flow 'volume_create_manager' (2021486e-8d74-42bd-b0a4-b4712cc3d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1981f3a-7ddb-4726-bed8-34cee1ab5f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1981f3a-7ddb-4726-bed8-34cee1ab5f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027592828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351c44c5-c984-4062-a307-1ccbf54a5240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3bc9f53606477bbddda9776889de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:54Z,use_quota=True,user_id='e971014b21224bdea0393c214af7d377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5769d0d-a7a3-4819-aa71-d5b404a3bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack sudo[115309]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5769d0d-a7a3-4819-aa71-d5b404a3bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83542bf4-228b-436b-acd6-210b86d09476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83542bf4-228b-436b-acd6-210b86d09476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351c44c5-c984-4062-a307-1ccbf54a5240', 'volume_name': 'volume-351c44c5-c984-4062-a307-1ccbf54a5240', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d894bc-4e7e-4529-947a-e0d9c7ded6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d894bc-4e7e-4529-947a-e0d9c7ded6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c4c8ac-3cda-473a-99cf-3255e431591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Volume 351c44c5-c984-4062-a307-1ccbf54a5240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351c44c5-c984-4062-a307-1ccbf54a5240', 'volume_size': 1} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 1073741824" returned: 0 in 0.517s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:54 devstack sudo[115315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 Aug 17 16:36:54 devstack sudo[115315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:54 devstack sudo[115315]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" returned: 0 in 0.244s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1027592828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351c44c5-c984-4062-a307-1ccbf54a5240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee3bc9f53606477bbddda9776889de68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:36:54Z,use_quota=True,user_id='e971014b21224bdea0393c214af7d377',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Creating volume 351c44c5-c984-4062-a307-1ccbf54a5240 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:36:54 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e619303-a9c8-4bc4-83dc-4e9872704953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack sudo[115318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 1073741824 Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804dd43c-89bb-4f19-9a46-1600bc0b5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:54 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:54 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Volume volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 (38a0bd41-2461-4bd7-b265-34ca9c06c9b8): created successfully Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (804dd43c-89bb-4f19-9a46-1600bc0b5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:54 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (360b3dc6-1af7-4c10-a843-e078803cec5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:54 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-faaadb6f-39a0-4dae-b0df-41fbbe1cbdff tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:36:55 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 1073741824" returned: 0 in 0.414s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:55 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 Aug 17 16:36:55 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:55 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240" returned: 0 in 0.239s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c4c8ac-3cda-473a-99cf-3255e431591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351c44c5-c984-4062-a307-1ccbf54a5240', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5987db2-8046-4412-b9c9-857d9ae0a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:36:55 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Volume volume-351c44c5-c984-4062-a307-1ccbf54a5240 (351c44c5-c984-4062-a307-1ccbf54a5240): created successfully Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5987db2-8046-4412-b9c9-857d9ae0a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Flow 'volume_create_manager' (2021486e-8d74-42bd-b0a4-b4712cc3d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:36:55 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a906b7b8-c4ca-476d-9b35-da053546a80b tempest-ProjectReaderTests-540622723 None] Created volume successfully. Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot 2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 of volume 38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4d4ad-632e-4449-8414-68cb1f6698c5]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:55 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:56 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 Aug 17 16:36:56 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:56 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" returned: 0 in 0.372s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:56 devstack sudo[115334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 1G Aug 17 16:36:56 devstack sudo[115334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Acquiring lock "cinder-351c44c5-c984-4062-a307-1ccbf54a5240-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "cinder-351c44c5-c984-4062-a307-1ccbf54a5240-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Acquiring lock "cinder-quobyte-351c44c5-c984-4062-a307-1ccbf54a5240" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "cinder-quobyte-351c44c5-c984-4062-a307-1ccbf54a5240" acquired by "delete_volume" :: waited 0.026s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[225a310b-717b-4714-86bc-ed6930d55791]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:56 devstack sudo[115336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 Aug 17 16:36:56 devstack sudo[115336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:56 devstack sudo[115334]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 1G" returned: 0 in 0.429s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:56 devstack sudo[115341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 Aug 17 16:36:56 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:56 devstack sudo[115336]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:56 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:56 devstack sudo[115346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240 Aug 17 16:36:56 devstack sudo[115346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:57 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" returned: 0 in 0.335s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:57 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 is being set with open permissions: ugo+rw Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:57 devstack sudo[115351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 Aug 17 16:36:57 devstack sudo[115351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:57 devstack sudo[115346]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-351c44c5-c984-4062-a307-1ccbf54a5240" returned: 0 in 0.256s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "cinder-quobyte-351c44c5-c984-4062-a307-1ccbf54a5240" released by "delete_volume" :: held 0.695s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Created reservations ['aa462787-5e20-4f79-afe6-d836de5e0a9c', 'dd6166c4-3a8c-4ccb-93e4-ac24e06e2f1f', 'e7b3be4e-72c7-4b1c-9af7-1fe836fbff1d', '584a88a4-40f4-4ac3-a147-316f72cf61f6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:57 devstack sudo[115351]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:57 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:36:57 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:57 devstack sudo[115357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info Aug 17 16:36:57 devstack sudo[115357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:57 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:36:57 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Deleted volume successfully. Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-3ba591fa-19d6-411f-9f8e-fac64399b8a4 tempest-ProjectReaderTests-540622723 None] Lock "cinder-351c44c5-c984-4062-a307-1ccbf54a5240-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:36:57 devstack sudo[115357]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info" returned: 0 in 0.334s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:57 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info is being set with open permissions: ugo+rw Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:57 devstack sudo[115362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info Aug 17 16:36:57 devstack sudo[115362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:57 devstack sudo[115362]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:57 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.info" returned: 0 in 0.289s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:58 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:36:58 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-63cb1c93-98e6-422e-8762-4da472350fbf tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot 2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 of volume 38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f24675-903a-45e2-92db-910ee1b6b3fe]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:59 devstack sudo[115365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 Aug 17 16:36:59 devstack sudo[115365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:36:59 devstack sudo[115365]: pam_unix(sudo:session): session closed for user root Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" returned: 0 in 0.387s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[84378146-420d-441b-94bd-fb3e284746a9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:36:59 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:36:59 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 Aug 17 16:36:59 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:00 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" returned: 0 in 0.387s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:00 devstack sudo[115375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 Aug 17 16:37:00 devstack sudo[115375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:00 devstack sudo[115375]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" returned: 0 in 0.376s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:00 devstack sudo[115381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4 Aug 17 16:37:00 devstack sudo[115381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:00 devstack sudo[115381]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8.2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" returned: 0 in 0.282s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4" released by "_delete_snapshot" :: held 1.536s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" released by "delete_snapshot" :: held 1.565s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Created reservations ['1bd222bd-722a-4223-9018-e207552ee159', '15853faa-e14c-4c23-9ad5-385414030318', '0212af08-a886-4fb5-90f0-6d1bba374200', 'f4243557-14a4-4110-8641-3711c5c02f7d'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:00 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:00 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-d845be78-d3c9-4c0a-b6cd-b734d9645fc0 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-2e2a3ff4-afba-44a4-86ec-60ed0e613fe4-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-38a0bd41-2461-4bd7-b265-34ca9c06c9b8-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-38a0bd41-2461-4bd7-b265-34ca9c06c9b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4c5ff-dea2-4ebf-93c9-483c20865668]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:01 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 Aug 17 16:37:01 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:01 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" returned: 0 in 0.358s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:01 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:01 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8 Aug 17 16:37:01 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:02 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" returned: 0 in 0.250s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-38a0bd41-2461-4bd7-b265-34ca9c06c9b8" released by "delete_volume" :: held 0.668s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Created reservations ['792dc7ad-1e2a-4b41-ab17-fd0ec25e8ef8', '01b37dd7-349b-4ced-a255-456cff39ece9', '0a787b5d-e9ac-4d53-a963-1d993ba6805e', '87fbbb98-2a22-4943-9517-07f4de91984b'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:02 devstack sudo[115392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:02 devstack sudo[115392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:02 devstack sudo[115392]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:02 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-02ac452c-2568-4dcc-9fd4-c8cba95345e9 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-38a0bd41-2461-4bd7-b265-34ca9c06c9b8-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (63f2182a-38d6-4aec-af75-4fceaa8da7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926f63e1-8a4e-43ca-bb2c-4a08c6a7ab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926f63e1-8a4e-43ca-bb2c-4a08c6a7ab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835580153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e17e2a8-679f-4c89-99be-2e0956707453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:03Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:02 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdab76f1-1a62-40a5-bcee-13dc00993ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdab76f1-1a62-40a5-bcee-13dc00993ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2d0a6c-a20e-4b6a-ae58-859e2eadbfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2d0a6c-a20e-4b6a-ae58-859e2eadbfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e17e2a8-679f-4c89-99be-2e0956707453', 'volume_name': 'volume-6e17e2a8-679f-4c89-99be-2e0956707453', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da28df3-8b37-4fbd-ad18-766c7695ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da28df3-8b37-4fbd-ad18-766c7695ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e8932-0ce4-4267-bdd9-ddc868b50bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Volume 6e17e2a8-679f-4c89-99be-2e0956707453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e17e2a8-679f-4c89-99be-2e0956707453', 'volume_size': 1} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835580153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e17e2a8-679f-4c89-99be-2e0956707453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:03Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Creating volume 6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:03 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:03 devstack sudo[115395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 1073741824 Aug 17 16:37:03 devstack sudo[115395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:03 devstack sudo[115395]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 1073741824" returned: 0 in 0.493s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:03 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 Aug 17 16:37:03 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:03 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453" returned: 0 in 0.264s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6e8932-0ce4-4267-bdd9-ddc868b50bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e17e2a8-679f-4c89-99be-2e0956707453', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea41eb1-f88e-4ed3-99fe-addef9b2929f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:03 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Volume volume-6e17e2a8-679f-4c89-99be-2e0956707453 (6e17e2a8-679f-4c89-99be-2e0956707453): created successfully Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea41eb1-f88e-4ed3-99fe-addef9b2929f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:03 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (63f2182a-38d6-4aec-af75-4fceaa8da7d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:03 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-58291848-8ce4-4d16-b44b-bd6c90828a4c tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot 9b3575a5-d763-4822-8d90-9e6656e8ab8c of volume 6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b504c28-3e7d-4477-b380-b48cf328df4e]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:05 devstack sudo[115406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 Aug 17 16:37:05 devstack sudo[115406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:05 devstack sudo[115406]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453" returned: 0 in 0.409s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:05 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:05 devstack sudo[115411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c 1G Aug 17 16:37:05 devstack sudo[115411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:06 devstack sudo[115411]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c 1G" returned: 0 in 0.494s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e17e2a8-679f-4c89-99be-2e0956707453 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:06 devstack sudo[115417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e17e2a8-679f-4c89-99be-2e0956707453 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c Aug 17 16:37:06 devstack sudo[115417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:06 devstack sudo[115417]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e17e2a8-679f-4c89-99be-2e0956707453 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c" returned: 0 in 0.384s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:06 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c is being set with open permissions: ugo+rw Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:06 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c Aug 17 16:37:06 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:06 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c" returned: 0 in 0.283s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:06 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:06 devstack sudo[115425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info Aug 17 16:37:06 devstack sudo[115425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:07 devstack sudo[115425]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info" returned: 0 in 0.318s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:07 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info is being set with open permissions: ugo+rw Aug 17 16:37:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:07 devstack sudo[115428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info Aug 17 16:37:07 devstack sudo[115428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:07 devstack sudo[115428]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.info" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:07 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:07 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e3014d3c-37a4-40a1-b667-6eb597537e5a tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-9b3575a5-d763-4822-8d90-9e6656e8ab8c-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-9b3575a5-d763-4822-8d90-9e6656e8ab8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-9b3575a5-d763-4822-8d90-9e6656e8ab8c" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-9b3575a5-d763-4822-8d90-9e6656e8ab8c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot 9b3575a5-d763-4822-8d90-9e6656e8ab8c of volume 6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be151f0-be1d-4615-9c10-7fe70f55b626]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:08 devstack sudo[115431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c Aug 17 16:37:08 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:08 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c" returned: 0 in 0.406s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:08 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e17e2a8-679f-4c89-99be-2e0956707453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[5859ee05-123f-4e44-b72b-61e6cc65a1f9]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:09 devstack sudo[115436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 Aug 17 16:37:09 devstack sudo[115436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:09 devstack sudo[115436]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:09 devstack sudo[115441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c Aug 17 16:37:09 devstack sudo[115441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:09 devstack sudo[115441]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c" returned: 0 in 0.359s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:09 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:09 devstack sudo[115446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c Aug 17 16:37:09 devstack sudo[115446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:10 devstack sudo[115446]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453.9b3575a5-d763-4822-8d90-9e6656e8ab8c" returned: 0 in 0.338s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-9b3575a5-d763-4822-8d90-9e6656e8ab8c" released by "_delete_snapshot" :: held 1.586s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" released by "delete_snapshot" :: held 1.624s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Created reservations ['c5185b93-397c-4981-865b-c90d1c886e6c', 'e48d2aac-6eea-4101-adbd-f318fc52dcec', 'dadb9124-6601-4be9-aa3d-19c05e4fc8a0', 'a287f651-44aa-43ca-a9cd-0b13a45fe1ca'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:10 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-e406b881-4781-42eb-9f90-7d6dd0beeaf6 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-9b3575a5-d763-4822-8d90-9e6656e8ab8c-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-6e17e2a8-679f-4c89-99be-2e0956707453-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-6e17e2a8-679f-4c89-99be-2e0956707453-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa22bc71-c4ac-418c-86b1-66f44476cae2]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:10 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:10 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 Aug 17 16:37:10 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:11 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453" returned: 0 in 0.412s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:11 devstack sudo[115454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453 Aug 17 16:37:11 devstack sudo[115454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:11 devstack sudo[115454]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-6e17e2a8-679f-4c89-99be-2e0956707453" returned: 0 in 0.284s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-6e17e2a8-679f-4c89-99be-2e0956707453" released by "delete_volume" :: held 0.773s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Created reservations ['23059152-fbe4-4fda-9618-726da4fef177', 'fde2635d-e51e-46dc-b12c-0ecf8b479aaa', 'bfd300a3-a444-41c0-be55-79091f410a61', '098edc0d-fc18-46ec-90ac-695f0014a1b1'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:11 devstack sudo[115457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:11 devstack sudo[115457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:11 devstack sudo[115457]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.288s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:11 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:12 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-79f04cc5-b786-4d1b-ad9c-2dda501fbeb5 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-6e17e2a8-679f-4c89-99be-2e0956707453-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (b04e0bf0-d805-4b47-bd83-3ac70b6e4f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd5806a-4dda-4ba3-8e18-596191a439ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd5806a-4dda-4ba3-8e18-596191a439ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772446919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff77ac3-b296-4cdf-8751-6c298ed7304f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:12Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be032352-194e-459e-8278-d050f0cb7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be032352-194e-459e-8278-d050f0cb7032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee43cab-05f4-4884-882d-6a06934e39bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee43cab-05f4-4884-882d-6a06934e39bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff77ac3-b296-4cdf-8751-6c298ed7304f', 'volume_name': 'volume-fff77ac3-b296-4cdf-8751-6c298ed7304f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799aab7-eb8f-471d-ba16-2de42ac54b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799aab7-eb8f-471d-ba16-2de42ac54b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e88463-238d-48ef-bca4-fa5c5f7e037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:12 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Volume fff77ac3-b296-4cdf-8751-6c298ed7304f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff77ac3-b296-4cdf-8751-6c298ed7304f', 'volume_size': 1} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-772446919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff77ac3-b296-4cdf-8751-6c298ed7304f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:12Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Creating volume fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:12 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:12 devstack sudo[115460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f 1073741824 Aug 17 16:37:12 devstack sudo[115460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:12 devstack sudo[115460]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f 1073741824" returned: 0 in 0.473s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:12 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:13 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f Aug 17 16:37:13 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:13 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f" returned: 0 in 0.265s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e88463-238d-48ef-bca4-fa5c5f7e037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff77ac3-b296-4cdf-8751-6c298ed7304f', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0f6219-4368-43c4-abef-9948495a95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:13 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Volume volume-fff77ac3-b296-4cdf-8751-6c298ed7304f (fff77ac3-b296-4cdf-8751-6c298ed7304f): created successfully Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0f6219-4368-43c4-abef-9948495a95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:13 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (b04e0bf0-d805-4b47-bd83-3ac70b6e4f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:13 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-bdcfe294-34e1-47bf-a22f-74e668b6366c tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:37:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:14 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot e2f785d3-b1db-4513-b433-26a6c919e6c1 of volume fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:14 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95269af-40c9-4f92-9618-db89bde256f4]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:14 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:14 devstack sudo[115471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f Aug 17 16:37:14 devstack sudo[115471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:15 devstack sudo[115471]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:15 devstack sudo[115476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 1G Aug 17 16:37:15 devstack sudo[115476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:15 devstack sudo[115476]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 1G" returned: 0 in 0.620s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:15 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff77ac3-b296-4cdf-8751-6c298ed7304f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:15 devstack sudo[115482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff77ac3-b296-4cdf-8751-6c298ed7304f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 Aug 17 16:37:15 devstack sudo[115482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:16 devstack sudo[115482]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fff77ac3-b296-4cdf-8751-6c298ed7304f -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1" returned: 0 in 0.313s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:16 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 is being set with open permissions: ugo+rw Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:16 devstack sudo[115488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 Aug 17 16:37:16 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:16 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1" returned: 0 in 0.263s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:16 devstack sudo[115491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info Aug 17 16:37:16 devstack sudo[115491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:16 devstack sudo[115491]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info" returned: 0 in 0.295s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:16 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info is being set with open permissions: ugo+rw Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:16 devstack sudo[115494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info Aug 17 16:37:16 devstack sudo[115494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:16 devstack sudo[115494]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:16 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.info" returned: 0 in 0.300s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=185,cinder:INSERT=67,cinder:DELETE=16,cinder:UPDATE=239 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:UPDATE=241,cinder:SELECT=178,cinder:INSERT=59,cinder:DELETE=25 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:37:17 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-530af3a5-f090-40d8-9496-8f5dca3b5739 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-e2f785d3-b1db-4513-b433-26a6c919e6c1-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-e2f785d3-b1db-4513-b433-26a6c919e6c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-e2f785d3-b1db-4513-b433-26a6c919e6c1" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-e2f785d3-b1db-4513-b433-26a6c919e6c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot e2f785d3-b1db-4513-b433-26a6c919e6c1 of volume fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:17 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c18ef4-b805-4999-a2dd-cbf97f804bad]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:18 devstack sudo[115497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 Aug 17 16:37:18 devstack sudo[115497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:18 devstack sudo[115497]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1" returned: 0 in 0.400s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fff77ac3-b296-4cdf-8751-6c298ed7304f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26155d0-f574-44e7-9f2c-4d1d19c9fb49]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:18 devstack sudo[115503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f Aug 17 16:37:18 devstack sudo[115503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:18 devstack sudo[115503]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f" returned: 0 in 0.394s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:18 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:18 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 Aug 17 16:37:18 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:19 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1" returned: 0 in 0.403s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:19 devstack sudo[115513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1 Aug 17 16:37:19 devstack sudo[115513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:19 devstack sudo[115513]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f.e2f785d3-b1db-4513-b433-26a6c919e6c1" returned: 0 in 0.293s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-e2f785d3-b1db-4513-b433-26a6c919e6c1" released by "_delete_snapshot" :: held 1.604s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" released by "delete_snapshot" :: held 1.630s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Created reservations ['3d2dba27-11c1-48ea-9adb-352cbab28369', 'b24e35e8-ad99-400f-bc33-1c0d3382b9c2', '08a256dc-f53b-4198-bdee-89c31630f4d6', '9baf7ace-07a2-40ed-a35c-7a5a74144703'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:19 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:19 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-ed58084f-e014-4708-afc9-868394370f90 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-e2f785d3-b1db-4513-b433-26a6c919e6c1-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Flow 'volume_create_manager' (58e20259-f0fa-4398-9ff2-6c35df1bb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b7490b-873c-4589-9a98-25b11676485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-fff77ac3-b296-4cdf-8751-6c298ed7304f-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b7490b-873c-4589-9a98-25b11676485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679711655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361c06de-23d1-4af6-9b83-c8efdbd06731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0aa9da183d4f3ea544defa89c4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:20Z,use_quota=True,user_id='f985b27f0b6a4561b772e47e88227de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c812928-560f-4984-bc25-3aac9d248c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c812928-560f-4984-bc25-3aac9d248c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf1c4c-72b0-4579-96e2-24a4a550ce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf1c4c-72b0-4579-96e2-24a4a550ce2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361c06de-23d1-4af6-9b83-c8efdbd06731', 'volume_name': 'volume-361c06de-23d1-4af6-9b83-c8efdbd06731', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49010ede-3234-4cbf-9524-3fee59633da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49010ede-3234-4cbf-9524-3fee59633da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d3cc4-fb21-4ddd-acba-0cc7cdc47460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Volume 361c06de-23d1-4af6-9b83-c8efdbd06731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361c06de-23d1-4af6-9b83-c8efdbd06731', 'volume_size': 1} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679711655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361c06de-23d1-4af6-9b83-c8efdbd06731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0aa9da183d4f3ea544defa89c4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:20Z,use_quota=True,user_id='f985b27f0b6a4561b772e47e88227de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Creating volume 361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:20 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "cinder-fff77ac3-b296-4cdf-8751-6c298ed7304f-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:20 devstack sudo[115516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 1073741824 Aug 17 16:37:20 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" acquired by "delete_volume" :: waited 0.014s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[382ab9fc-b6ce-4bb5-a83a-06f74117d6bb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:20 devstack sudo[115518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f Aug 17 16:37:20 devstack sudo[115518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:20 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 1073741824" returned: 0 in 0.449s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:20 devstack sudo[115518]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f" returned: 0 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:20 devstack sudo[115527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:20 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:20 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f Aug 17 16:37:20 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:20 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.237s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d3cc4-fb21-4ddd-acba-0cc7cdc47460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361c06de-23d1-4af6-9b83-c8efdbd06731', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda441a-1cfd-4396-8212-dec4ac3227f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-fff77ac3-b296-4cdf-8751-6c298ed7304f" returned: 0 in 0.263s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:20 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Volume volume-361c06de-23d1-4af6-9b83-c8efdbd06731 (361c06de-23d1-4af6-9b83-c8efdbd06731): created successfully Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda441a-1cfd-4396-8212-dec4ac3227f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Flow 'volume_create_manager' (58e20259-f0fa-4398-9ff2-6c35df1bb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:20 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-fff77ac3-b296-4cdf-8751-6c298ed7304f" released by "delete_volume" :: held 0.715s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-9268cf14-29af-4139-becc-368f5d26983e tempest-SnapshotDependencyTests-381328280 None] Created volume successfully. Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Created reservations ['a662ee0c-afd2-4845-b40f-fb76ca9cbbff', '887b9bbf-1bbd-430c-a906-3281cb06b226', '1ea3985f-b9c9-4f32-9833-852b218e0dae', 'ebe7d5de-2d1c-4589-9d8e-ebd61a457207'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:21 devstack sudo[115533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:21 devstack sudo[115533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:21 devstack sudo[115533]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.246s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:21 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-0f5ae608-9131-4739-8c1c-d768b477ec5d tempest-ProjectMemberTests-1637810001 None] Lock "cinder-fff77ac3-b296-4cdf-8751-6c298ed7304f-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (91784fe3-5aa5-4842-96e0-da15305707c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcdc39e-52f9-4367-8374-839ef5b80cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcdc39e-52f9-4367-8374-839ef5b80cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140267031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c459f0-454c-4579-a28d-1f28e7f8844b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:22Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e35264e-ea5f-4581-8be1-7dc37c7b003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e35264e-ea5f-4581-8be1-7dc37c7b003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4381888c-4ade-4e78-81db-ded83f733eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4381888c-4ade-4e78-81db-ded83f733eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c459f0-454c-4579-a28d-1f28e7f8844b', 'volume_name': 'volume-68c459f0-454c-4579-a28d-1f28e7f8844b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0de493f-6740-4532-9072-858d6724bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0de493f-6740-4532-9072-858d6724bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfddfffa-5fe3-421e-a461-9bca7c666c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:21 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Volume 68c459f0-454c-4579-a28d-1f28e7f8844b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c459f0-454c-4579-a28d-1f28e7f8844b', 'volume_size': 1} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140267031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c459f0-454c-4579-a28d-1f28e7f8844b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:22Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Creating volume 68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:21 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:21 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:21 devstack sudo[115536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b 1073741824 Aug 17 16:37:21 devstack sudo[115536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:22 devstack sudo[115536]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b 1073741824" returned: 0 in 0.466s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:22 devstack sudo[115541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b Aug 17 16:37:22 devstack sudo[115541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:22 devstack sudo[115541]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b" returned: 0 in 0.259s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.194s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfddfffa-5fe3-421e-a461-9bca7c666c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c459f0-454c-4579-a28d-1f28e7f8844b', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5763560b-772f-4e56-9574-8f3262119db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Creating offline snapshot 1987143d-444c-4f2b-b568-a03f48bc03c0 of volume 361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:22 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Volume volume-68c459f0-454c-4579-a28d-1f28e7f8844b (68c459f0-454c-4579-a28d-1f28e7f8844b): created successfully Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5763560b-772f-4e56-9574-8f3262119db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (91784fe3-5aa5-4842-96e0-da15305707c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ad1fce-7386-48b8-be12-042dff70e780]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:22 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:22 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-101164fe-00d0-40a6-972f-8d9b6a8d8878 tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:37:22 devstack sudo[115544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:22 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:23 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.375s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:23 devstack sudo[115549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 1G Aug 17 16:37:23 devstack sudo[115549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:23 devstack sudo[115549]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 1G" returned: 0 in 0.387s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361c06de-23d1-4af6-9b83-c8efdbd06731 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:23 devstack sudo[115555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361c06de-23d1-4af6-9b83-c8efdbd06731 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:23 devstack sudo[115555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:23 devstack sudo[115555]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361c06de-23d1-4af6-9b83-c8efdbd06731 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.276s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:23 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 is being set with open permissions: ugo+rw Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:23 devstack sudo[115560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:23 devstack sudo[115560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:23 devstack sudo[115560]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.266s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:23 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:24 devstack sudo[115564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info Aug 17 16:37:24 devstack sudo[115564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:24 devstack sudo[115564]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info" returned: 0 in 0.243s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:24 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info is being set with open permissions: ugo+rw Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:24 devstack sudo[115567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info Aug 17 16:37:24 devstack sudo[115567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:24 devstack sudo[115567]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.info" returned: 0 in 0.234s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.533s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot bf356e0e-bf69-4def-9a0c-e2e0682b53fd of volume 68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:24 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-4a2bc43a-80c9-4fb3-b734-e442ddea8b56 tempest-SnapshotDependencyTests-381328280 None] Create snapshot completed successfully Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe95613-e3b2-4353-9b54-7eef56808e15]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:24 devstack sudo[115570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b Aug 17 16:37:24 devstack sudo[115570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:24 devstack sudo[115570]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b" returned: 0 in 0.350s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:24 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:24 devstack sudo[115575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd 1G Aug 17 16:37:24 devstack sudo[115575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:25 devstack sudo[115575]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd 1G" returned: 0 in 0.379s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c459f0-454c-4579-a28d-1f28e7f8844b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:25 devstack sudo[115580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c459f0-454c-4579-a28d-1f28e7f8844b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd Aug 17 16:37:25 devstack sudo[115580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:25 devstack sudo[115580]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c459f0-454c-4579-a28d-1f28e7f8844b -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd" returned: 0 in 0.295s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:25 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd is being set with open permissions: ugo+rw Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:25 devstack sudo[115585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd Aug 17 16:37:25 devstack sudo[115585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:25 devstack sudo[115585]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd" returned: 0 in 0.259s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:25 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:25 devstack sudo[115588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info Aug 17 16:37:25 devstack sudo[115588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:26 devstack sudo[115588]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:26 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info is being set with open permissions: ugo+rw Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:26 devstack sudo[115591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info Aug 17 16:37:26 devstack sudo[115591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Flow 'volume_create_manager' (35faef51-37b8-4931-ac2a-502bd290c956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359a1456-a5bf-472c-a051-83c0ffdd161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359a1456-a5bf-472c-a051-83c0ffdd161e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ec2a02-04ea-48c9-aab4-af684cb7a2aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0aa9da183d4f3ea544defa89c4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1987143d-444c-4f2b-b568-a03f48bc03c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:26Z,use_quota=True,user_id='f985b27f0b6a4561b772e47e88227de1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093cd519-d0ab-4193-bc01-ae0dc6e664cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093cd519-d0ab-4193-bc01-ae0dc6e664cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad21455-8bf8-48e9-b7f1-d6102289f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad21455-8bf8-48e9-b7f1-d6102289f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4ec2a02-04ea-48c9-aab4-af684cb7a2aa', 'volume_name': 'volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa', 'volume_size': 1, 'snapshot_id': '1987143d-444c-4f2b-b568-a03f48bc03c0'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc3d84-8555-43cc-a202-2e58f1175444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dc3d84-8555-43cc-a202-2e58f1175444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9eaae2-26a3-438e-ab27-a31011244d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:26 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Volume a4ec2a02-04ea-48c9-aab4-af684cb7a2aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa', 'volume_size': 1, 'snapshot_id': '1987143d-444c-4f2b-b568-a03f48bc03c0'} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:26 devstack sudo[115591]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.info" returned: 0 in 0.247s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.138s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" by "_create_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Creating volume a4ec2a02-04ea-48c9-aab4-af684cb7a2aa from snapshot 1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" by "_copy_volume_from_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] snapshot: 1987143d-444c-4f2b-b568-a03f48bc03c0, volume: a4ec2a02-04ea-48c9-aab4-af684cb7a2aa, {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 17 16:37:26 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-45bdcfb5-0f6e-454b-a65a-c25ef31222a6 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9302b6a-4f6e-4bcb-8ec1-3bf56a878dfb]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:26 devstack sudo[115594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:26 devstack sudo[115594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:26 devstack sudo[115594]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361c06de-23d1-4af6-9b83-c8efdbd06731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d113e2-f96e-4fcd-83c5-31728b1bd584]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:26 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:26 devstack sudo[115599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:26 devstack sudo[115599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-bf356e0e-bf69-4def-9a0c-e2e0682b53fd-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-bf356e0e-bf69-4def-9a0c-e2e0682b53fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-bf356e0e-bf69-4def-9a0c-e2e0682b53fd" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf356e0e-bf69-4def-9a0c-e2e0682b53fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot bf356e0e-bf69-4def-9a0c-e2e0682b53fd of volume 68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3cb91b-f18e-4f72-8a89-b2bd3517b889]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:27 devstack sudo[115599]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.382s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Creating direct copy from snapshot {{(pid=94468) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.utils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Path /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa not found in is_blk_device check {{(pid=94468) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:27 devstack sudo[115605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa Aug 17 16:37:27 devstack sudo[115605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:27 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd Aug 17 16:37:27 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:27 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c459f0-454c-4579-a28d-1f28e7f8844b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce88a19-dfad-44e2-86fa-40be45c75fae]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:27 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:27 devstack sudo[115615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b Aug 17 16:37:27 devstack sudo[115615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:28 devstack sudo[115615]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b" returned: 0 in 0.711s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:28 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:28 devstack sudo[115626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd Aug 17 16:37:28 devstack sudo[115626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:29 devstack sudo[115626]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd" returned: 0 in 0.750s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:29 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd Aug 17 16:37:29 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:29 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b.bf356e0e-bf69-4def-9a0c-e2e0682b53fd" returned: 0 in 0.596s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-bf356e0e-bf69-4def-9a0c-e2e0682b53fd" released by "_delete_snapshot" :: held 2.551s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" released by "delete_snapshot" :: held 2.582s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:29 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Created reservations ['5a7ae00a-47ec-42fb-a167-3672d1503d95', '1f0ec9e6-d5b8-4348-b7da-b25222c01cf6', '79dd884e-0ea7-4232-9432-94eb58cc19df', '7c3ccb05-93a6-4fc1-9db9-e4185ea50450'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:30 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5ec1c103-a8f8-4e34-94a1-3f82968e5a53 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-bf356e0e-bf69-4def-9a0c-e2e0682b53fd-delete_snapshot" released by "delete_snapshot" :: held 3.055s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-68c459f0-454c-4579-a28d-1f28e7f8844b-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "cinder-68c459f0-454c-4579-a28d-1f28e7f8844b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" acquired by "delete_volume" :: waited 0.055s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5a924-25ca-45b4-ab34-add9fe6937ab]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:30 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:31 devstack sudo[115642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b Aug 17 16:37:31 devstack sudo[115642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:31 devstack sudo[115642]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b" returned: 0 in 0.611s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:31 devstack sudo[115647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b Aug 17 16:37:31 devstack sudo[115647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:31 devstack sudo[115647]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:31 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-68c459f0-454c-4579-a28d-1f28e7f8844b" returned: 0 in 0.392s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-68c459f0-454c-4579-a28d-1f28e7f8844b" released by "delete_volume" :: held 1.203s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:32 devstack sudo[115605]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" returned: 0 in 4.876s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.image.image_utils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Image conversion details: src /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa {{(pid=94468) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 17 16:37:32 devstack cinder-volume[94468]: INFO cinder.image.image_utils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Converted 1024.00 MB image at 209.96 MB/s Aug 17 16:37:32 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa is being set with open permissions: ugo+rw Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Created reservations ['c1fe0dcc-5d24-46af-b846-278a2d0ecdeb', '0c95b2f0-5a74-4b4e-bc09-d6ba890b6dca', 'cb0b6efe-9e7c-4664-bf1b-caa291fe1918', '4fcf10a0-d2f7-4acc-82aa-eee6a06fac2f'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:32 devstack sudo[115650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa Aug 17 16:37:32 devstack sudo[115650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:32 devstack sudo[115652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:32 devstack sudo[115652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:32 devstack sudo[115650]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" returned: 0 in 0.255s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" released by "_copy_volume_from_snapshot" :: held 5.962s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" released by "_create_volume_from_snapshot" :: held 6.044s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.065s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:32 devstack sudo[115652]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.254s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9eaae2-26a3-438e-ab27-a31011244d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa', 'volume_size': 1, 'snapshot_id': '1987143d-444c-4f2b-b568-a03f48bc03c0'}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d55469a-e643-4dbd-be70-1cb5df1704d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-acdb5e91-0ac9-4fbc-8029-9e4c4f3671af tempest-ProjectMemberTests-1637810001 None] Lock "cinder-68c459f0-454c-4579-a28d-1f28e7f8844b-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:32 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Volume volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa (a4ec2a02-04ea-48c9-aab4-af684cb7a2aa): created successfully Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d55469a-e643-4dbd-be70-1cb5df1704d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Flow 'volume_create_manager' (35faef51-37b8-4931-ac2a-502bd290c956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:32 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b0ac6444-f6bd-413a-859d-6c07f14c343e tempest-SnapshotDependencyTests-381328280 None] Created volume successfully. Aug 17 16:37:32 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-1987143d-444c-4f2b-b568-a03f48bc03c0-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-1987143d-444c-4f2b-b568-a03f48bc03c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Deleting offline snapshot 1987143d-444c-4f2b-b568-a03f48bc03c0 of volume 361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] snapshot_file for this snap is: volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e089be-4647-42dc-9402-2a4ccc15d135]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:33 devstack sudo[115656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:33 devstack sudo[115656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:33 devstack sudo[115656]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.389s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361c06de-23d1-4af6-9b83-c8efdbd06731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09188e-73c3-49a1-b354-4fd5be0c7bca]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:33 devstack sudo[115661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:33 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (1a5b116c-9f4c-451e-a08d-f726e663f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e0aa50-24dc-4edd-99a8-f67bebb036aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e0aa50-24dc-4edd-99a8-f67bebb036aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071658439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17bc40-b4c2-44cc-9880-0a44906da6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:34Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4171f49b-4595-4478-b833-fcc52254c3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4171f49b-4595-4478-b833-fcc52254c3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac4a8c8-bf80-4e71-a54b-a8d93b7a2c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac4a8c8-bf80-4e71-a54b-a8d93b7a2c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a17bc40-b4c2-44cc-9880-0a44906da6d5', 'volume_name': 'volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a20f9e1-2439-4f35-af28-86406b913dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a20f9e1-2439-4f35-af28-86406b913dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b05c4c3-b6c1-43ef-b511-ecba6bc63a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:33 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Volume 2a17bc40-b4c2-44cc-9880-0a44906da6d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5', 'volume_size': 1} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2071658439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a17bc40-b4c2-44cc-9880-0a44906da6d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:34Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Creating volume 2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:33 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:33 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:33 devstack sudo[115663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 1073741824 Aug 17 16:37:33 devstack sudo[115663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:34 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.557s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:34 devstack sudo[115672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:34 devstack sudo[115672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:34 devstack sudo[115663]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 1073741824" returned: 0 in 0.457s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:34 devstack sudo[115675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 Aug 17 16:37:34 devstack sudo[115675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:34 devstack sudo[115672]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.351s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:34 devstack sudo[115680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0 Aug 17 16:37:34 devstack sudo[115680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:34 devstack sudo[115675]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5" returned: 0 in 0.251s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b05c4c3-b6c1-43ef-b511-ecba6bc63a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3c55c0-5f19-4167-945d-b7753003a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:34 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Volume volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 (2a17bc40-b4c2-44cc-9880-0a44906da6d5): created successfully Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3c55c0-5f19-4167-945d-b7753003a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (1a5b116c-9f4c-451e-a08d-f726e663f862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-68334670-f536-4177-a253-9614aa4763da tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:37:34 devstack sudo[115680]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731.1987143d-444c-4f2b-b568-a03f48bc03c0" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-1987143d-444c-4f2b-b568-a03f48bc03c0" released by "_delete_snapshot" :: held 1.665s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" released by "delete_snapshot" :: held 1.689s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Created reservations ['b516f38b-b455-4465-b869-a29eb9f1ba62', '45a8c25c-e9c6-45c1-b675-49fc0a9bd8fd', '57fcf808-09bd-45b2-887c-1e3917a96346', 'bce6440a-3c02-4eb2-8e96-c618b227e736'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:34 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Delete snapshot completed successfully. Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-730ed89a-8bce-4dd1-a756-b4869d54b430 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-1987143d-444c-4f2b-b568-a03f48bc03c0-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 of volume 2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edd0a5d-9f54-4f74-aa0e-ec3ef3d3cd54]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:34 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:35 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 Aug 17 16:37:35 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-361c06de-23d1-4af6-9b83-c8efdbd06731-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-361c06de-23d1-4af6-9b83-c8efdbd06731-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" acquired by "delete_volume" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2cd564-2c7e-499e-be38-4cba0286b65c]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:35 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5" returned: 0 in 0.416s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:35 devstack sudo[115726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 1G Aug 17 16:37:35 devstack sudo[115726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:35 devstack sudo[115725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:35 devstack sudo[115725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:35 devstack sudo[115725]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.381s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:35 devstack sudo[115735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731 Aug 17 16:37:35 devstack sudo[115735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:35 devstack sudo[115726]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 1G" returned: 0 in 0.411s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:35 devstack sudo[115737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 Aug 17 16:37:35 devstack sudo[115737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:35 devstack sudo[115735]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-361c06de-23d1-4af6-9b83-c8efdbd06731" returned: 0 in 0.256s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:35 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-361c06de-23d1-4af6-9b83-c8efdbd06731" released by "delete_volume" :: held 0.696s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Created reservations ['f91bb841-e840-4626-9bc5-f36a471fe4a5', '2d5d2f61-a83e-4486-9b45-fadff4530691', 'b839d310-fbef-413e-b5b3-b5d12c580980', '291a4b91-d4fd-4e18-aaa0-a4b3f48bd4ec'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:36 devstack sudo[115737]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" returned: 0 in 0.322s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 is being set with open permissions: ugo+rw Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 Aug 17 16:37:36 devstack sudo[115744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:36 devstack sudo[115746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack sudo[115744]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115746]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.257s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Deleted volume successfully. Aug 17 16:37:36 devstack sudo[115750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info Aug 17 16:37:36 devstack sudo[115750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-5f6f9968-0ed7-4a49-91d8-0931767d0245 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-361c06de-23d1-4af6-9b83-c8efdbd06731-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" acquired by "delete_volume" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b81cf-189c-419d-9d5b-2f2ca5b67bb8]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115750]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info is being set with open permissions: ugo+rw Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa Aug 17 16:37:36 devstack sudo[115752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack sudo[115755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info Aug 17 16:37:36 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.info" returned: 0 in 0.243s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack sudo[115752]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" returned: 0 in 0.383s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:36 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:36 devstack sudo[115761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa Aug 17 16:37:36 devstack sudo[115761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:36 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-cf0488a8-136c-4dcc-9e89-ede1e20b7809 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:37:37 devstack sudo[115761]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" returned: 0 in 0.247s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-quobyte-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa" released by "delete_volume" :: held 0.673s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Created reservations ['30c11bbc-6ee5-4d3f-a3cf-61b405e88b27', 'cf27ba08-157e-44be-b582-8e243cd1f556', 'd5b3689e-1e47-41eb-a399-ff594195e78e', '01d3577e-8f77-4f8d-94f7-562b335b37f8'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:37 devstack sudo[115764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:37 devstack sudo[115764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:37 devstack sudo[115764]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.254s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:37 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Deleted volume successfully. Aug 17 16:37:37 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-b7d5d7be-3024-4f30-b6cd-7a0205939f07 tempest-SnapshotDependencyTests-381328280 None] Lock "cinder-a4ec2a02-04ea-48c9-aab4-af684cb7a2aa-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 of volume 2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c391f44-85ad-4b11-acb9-66ef7cfdae67]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:38 devstack sudo[115767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 Aug 17 16:37:38 devstack sudo[115767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:38 devstack sudo[115767]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" returned: 0 in 0.396s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888d129-4937-4265-b564-e1f0d578eca0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:38 devstack sudo[115773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 Aug 17 16:37:38 devstack sudo[115773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:38 devstack sudo[115773]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5" returned: 0 in 0.371s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:38 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:38 devstack sudo[115778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 Aug 17 16:37:38 devstack sudo[115778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:39 devstack sudo[115778]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:39 devstack sudo[115785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88 Aug 17 16:37:39 devstack sudo[115785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:39 devstack sudo[115785]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5.aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" returned: 0 in 0.250s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88" released by "_delete_snapshot" :: held 1.483s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" released by "delete_snapshot" :: held 1.511s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Created reservations ['03c46167-ab87-43e1-b978-bd0d5e6aac14', 'dbd5a667-d69b-4212-b905-2f4d1f678a13', 'aa874491-6a2b-4dfb-ba8f-f73cb7b10284', '301210a8-7060-4041-869e-a2066ddf97bb'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:39 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:39 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-2e3bfcd7-2f6a-4db1-9666-fea76f6e999e tempest-ProjectMemberTests-1637810001 None] Lock "cinder-aa3a61f7-f70b-4ac4-ac71-cf79ad7f4a88-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-2a17bc40-b4c2-44cc-9880-0a44906da6d5-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-2a17bc40-b4c2-44cc-9880-0a44906da6d5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" acquired by "delete_volume" :: waited 0.014s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b837f-11e8-45a6-8da0-3b172572e2c0]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:40 devstack sudo[115788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 Aug 17 16:37:40 devstack sudo[115788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:40 devstack sudo[115788]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5" returned: 0 in 0.365s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:40 devstack sudo[115794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5 Aug 17 16:37:40 devstack sudo[115794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:40 devstack sudo[115794]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-2a17bc40-b4c2-44cc-9880-0a44906da6d5" returned: 0 in 0.265s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:40 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-2a17bc40-b4c2-44cc-9880-0a44906da6d5" released by "delete_volume" :: held 0.708s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Created reservations ['3b21e37e-8226-4cd5-91c3-1d9a54757c4a', '7a1641d6-0a47-4669-b35c-b942d5bcda46', 'd2f6bc97-7723-4d7f-a08c-5faefa629340', '6866d48f-37ab-40fd-ae83-3207a818d1c0'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:41 devstack sudo[115797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:41 devstack sudo[115797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:41 devstack sudo[115797]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.271s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:41 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-7c776891-3284-4ec7-8492-d6ec7a7cbd09 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-2a17bc40-b4c2-44cc-9880-0a44906da6d5-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94468) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (1a700ebb-5d36-4712-8cde-008dcd49e9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc72582-f244-480f-bbfb-80f5066296ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc72582-f244-480f-bbfb-80f5066296ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233159036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4546a9-c047-415b-9083-408b75e94320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:42Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4642d417-7121-4390-8eaf-b77c73ba1c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4642d417-7121-4390-8eaf-b77c73ba1c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305ab2c-3002-4fb9-8681-6bcdb06d32cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305ab2c-3002-4fb9-8681-6bcdb06d32cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca4546a9-c047-415b-9083-408b75e94320', 'volume_name': 'volume-ca4546a9-c047-415b-9083-408b75e94320', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78856394-2939-42d5-b07e-ee56296b0e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78856394-2939-42d5-b07e-ee56296b0e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbb2477-33b7-4a48-b8c6-7f2572323dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:41 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Volume ca4546a9-c047-415b-9083-408b75e94320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca4546a9-c047-415b-9083-408b75e94320', 'volume_size': 1} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-17T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233159036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca4546a9-c047-415b-9083-408b75e94320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f96a297fedf4ef1a5b0afab2cd6cdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-17T14:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-17T14:37:42Z,use_quota=True,user_id='6be09bdf96b3462f9aecd9d8ecc2c1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370d1d14-5dc6-4510-bb90-655be9b6ba69),volume_type_id=370d1d14-5dc6-4510-bb90-655be9b6ba69)}" {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Creating volume ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:41 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Selected osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 as target Quobyte volume. {{(pid=94468) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 17 16:37:42 devstack cinder-volume[94468]: INFO cinder.volume.drivers.remotefs [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] casted to osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3 Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 1073741824 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:42 devstack sudo[115801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 1073741824 Aug 17 16:37:42 devstack sudo[115801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:42 devstack sudo[115801]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 1073741824" returned: 0 in 0.443s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:42 devstack sudo[115806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 Aug 17 16:37:42 devstack sudo[115806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:42 devstack sudo[115806]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'} {{(pid=94468) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbb2477-33b7-4a48-b8c6-7f2572323dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca4546a9-c047-415b-9083-408b75e94320', 'volume_size': 1}' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0245e964-c2c3-4c01-9f7c-91b6118a07de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 17 16:37:42 devstack cinder-volume[94468]: INFO cinder.volume.flows.manager.create_volume [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Volume volume-ca4546a9-c047-415b-9083-408b75e94320 (ca4546a9-c047-415b-9083-408b75e94320): created successfully Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0245e964-c2c3-4c01-9f7c-91b6118a07de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94468) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 17 16:37:42 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Flow 'volume_create_manager' (1a700ebb-5d36-4712-8cde-008dcd49e9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94468) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 17 16:37:42 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-ba1a9f26-a422-47ea-bce0-e267a4de0575 tempest-ProjectMemberTests-1637810001 None] Created volume successfully. Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Creating offline snapshot d7ddc998-f440-4610-8166-b3623bb65eca of volume ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ffae61-fe3b-4625-9ce2-014d14edb603]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:44 devstack sudo[115811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 Aug 17 16:37:44 devstack sudo[115811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:44 devstack sudo[115811]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320" returned: 0 in 0.397s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca 1G {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:44 devstack sudo[115816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca 1G Aug 17 16:37:44 devstack sudo[115816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:44 devstack sudo[115816]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca 1G" returned: 0 in 0.401s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:44 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca4546a9-c047-415b-9083-408b75e94320 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:45 devstack sudo[115821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca4546a9-c047-415b-9083-408b75e94320 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca Aug 17 16:37:45 devstack sudo[115821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:45 devstack sudo[115821]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca4546a9-c047-415b-9083-408b75e94320 -F qcow2 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca" returned: 0 in 0.302s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca is being set with open permissions: ugo+rw Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:45 devstack sudo[115826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca Aug 17 16:37:45 devstack sudo[115826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:45 devstack sudo[115826]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca" returned: 0 in 0.296s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:45 devstack sudo[115829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info Aug 17 16:37:45 devstack sudo[115829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:45 devstack sudo[115829]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info" returned: 0 in 0.277s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:45 devstack cinder-volume[94468]: WARNING cinder.volume.drivers.remotefs [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info is being set with open permissions: ugo+rw Aug 17 16:37:45 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:45 devstack sudo[115832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info Aug 17 16:37:45 devstack sudo[115832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:46 devstack sudo[115832]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.info" returned: 0 in 0.274s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:46 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-789018b1-1e48-4932-bb6d-900fc112c863 tempest-ProjectMemberTests-1637810001 None] Create snapshot completed successfully Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:46 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:46 devstack sudo[115836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:46 devstack sudo[115836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:47 devstack sudo[115836]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-395ed020-a613-42e6-9009-afc95471e841 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.268s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo_service.periodic_task [None req-395ed020-a613-42e6-9009-afc95471e841 None None] Running periodic task VolumeManager._thread_info {{(pid=94468) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread count: 29 {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.volume.manager [None req-395ed020-a613-42e6-9009-afc95471e841 None None] thread info: [<_MainThread(MainThread, started 134000211394688)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94468) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-d7ddc998-f440-4610-8166-b3623bb65eca-delete_snapshot" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-d7ddc998-f440-4610-8166-b3623bb65eca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" by "delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-d7ddc998-f440-4610-8166-b3623bb65eca" by "_delete_snapshot" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-d7ddc998-f440-4610-8166-b3623bb65eca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Deleting offline snapshot d7ddc998-f440-4610-8166-b3623bb65eca of volume ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] snapshot_file for this snap is: volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75c9fc7-9d4f-42ef-a322-7f3458c99efa]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:47 devstack sudo[115839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca Aug 17 16:37:47 devstack sudo[115839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:47 devstack sudo[115839]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca" returned: 0 in 0.404s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.remotefs [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca4546a9-c047-415b-9083-408b75e94320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94468) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c4fe28-130b-41ae-9c8d-a3c99451d025]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:47 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:48 devstack sudo[115844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 Aug 17 16:37:48 devstack sudo[115844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:48 devstack sudo[115844]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320" returned: 0 in 0.376s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:48 devstack sudo[115849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca Aug 17 16:37:48 devstack sudo[115849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:48 devstack sudo[115849]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca" returned: 0 in 0.327s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:48 devstack sudo[115854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca Aug 17 16:37:48 devstack sudo[115854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:48 devstack sudo[115854]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320.d7ddc998-f440-4610-8166-b3623bb65eca" returned: 0 in 0.245s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-d7ddc998-f440-4610-8166-b3623bb65eca" released by "_delete_snapshot" :: held 1.450s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:48 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" released by "delete_snapshot" :: held 1.474s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Created reservations ['b3a95af7-a4c3-4fc1-a64b-96381346ba00', '16b9ee14-41c6-42c3-a8af-0d6d1abdf1ec', '7efa2df1-aa83-4840-85ba-1a990bd40a37', '4bc3acaf-a63c-4c67-821c-f846716a3b06'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:49 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Delete snapshot completed successfully. Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-feb5823e-03f1-4254-a665-4f626302198b tempest-ProjectMemberTests-1637810001 None] Lock "cinder-d7ddc998-f440-4610-8166-b3623bb65eca-delete_snapshot" released by "delete_snapshot" :: held 1.619s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-ca4546a9-c047-415b-9083-408b75e94320-delete_volume" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-ca4546a9-c047-415b-9083-408b75e94320-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" by "delete_volume" {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" acquired by "delete_volume" :: waited 0.015s {{(pid=94468) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG oslo.privsep.daemon [-] privsep: reply[568463f3-2ee2-4a3e-bb13-6e8b9515a91f]: (4, 'qcow2') {{(pid=96365) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 17 16:37:49 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:49 devstack sudo[115857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 Aug 17 16:37:49 devstack sudo[115857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:50 devstack sudo[115857]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320" returned: 0 in 0.361s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:50 devstack sudo[115862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320 Aug 17 16:37:50 devstack sudo[115862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:50 devstack sudo[115862]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee/volume-ca4546a9-c047-415b-9083-408b75e94320" returned: 0 in 0.247s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-quobyte-ca4546a9-c047-415b-9083-408b75e94320" released by "delete_volume" :: held 0.669s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.quota [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Created reservations ['486a9b74-7526-482c-8d88-b4a1b5783fa5', 'cbf6500d-cc2d-40c7-a9eb-fbcd21f7e14d', 'adc43b99-e4f3-4fb8-a656-edec02ff1f7b', '4f0d479f-6d70-4eff-b52c-4f5533624de6'] {{(pid=94468) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3': None} {{(pid=94468) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.volume.drivers.quobyte [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-aa757100-6f39-411a-bfcd-0e5de2375db3'] {{(pid=94468) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.lockutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94468) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 17 16:37:50 devstack sudo[115865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee Aug 17 16:37:50 devstack sudo[115865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 17 16:37:50 devstack sudo[115865]: pam_unix(sudo:session): session closed for user root Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG oslo_concurrency.processutils [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/561ea227bef985ced7c08bc2dfa5ebee" returned: 0 in 0.243s {{(pid=94468) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.manager [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Notifying Schedulers of capabilities ... {{(pid=94468) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 17 16:37:50 devstack cinder-volume[94468]: INFO cinder.volume.manager [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Deleted volume successfully. Aug 17 16:37:50 devstack cinder-volume[94468]: DEBUG cinder.coordination [None req-a242b0f2-79ce-45e4-8b91-29fd5fcd7ba7 tempest-ProjectMemberTests-1637810001 None] Lock "cinder-ca4546a9-c047-415b-9083-408b75e94320-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=94468) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 17 16:38:00 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:DELETE=7,cinder:SELECT=76,cinder:INSERT=25,cinder:UPDATE=104 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 17 16:38:00 devstack cinder-volume[94468]: DEBUG dbcounter [-] [94468] Writing DB stats cinder:SELECT=76,cinder:INSERT=28,cinder:UPDATE=89,cinder:DELETE=9 {{(pid=94468) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}